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preface 


For the student. Tradition dictates that textbooks should open with a few remarks 
by the author in which he explains what his particular book is all about. This obli- 
gation confronts the technical writer with something of a dilemma, since it is safe 
to assume that the student is unfamiliar with the subject at hand; otherwise he 
would hardly be reading it in the first place. Thus any serious attempt to describe 
the content of a mathematics text is sure to be lost on the beginner until after he 
has read the book, by which time, hopefully, he has discovered it for himself. 

Still, there are a few remarks which can be addressed to the student before he 
begins the task of learning a mathematical dicipline. Above all, he should be told 
what is expected of him in the way of prior knowledge, and just what special de- 
mands, if any, are going to be made of him as he proceeds. In the present case the 
first of these points is easily settled: We assume only a knowledge of elementary 
calculus and analytic geometry such as ts usually gained in a standard three-se- 
mester course on these subjects. In particular, the reader should have encountered 
the notion of an infinite series, and know how to take a partial derivative and eval- 
uate a double integral. Actually almost two-thirds of this book can be read without 
a knowledge of these last two items, while the first is covered quickly, but (for our 
purposes) adequately, in Appendix I. In short, we have kept formal prerequisites 
to a minimum. At the same time, however, we demand that the reader possess a 
certain amount of that elusive quality called mathematical maturity, by which we 
mean the patience to follow mathematical thought whither it may lead, and a will- 
ingness to postpone concrete applications until enough mathematics has been done 
to treat them properly. 

This last demand is a reflection of the fact that initially much of our work may 
seem rather abstract, especially to the student coming directly from calculus. Thus, 
even though we have made every effort to motivate our arguments by referring to 
familiar situations and have illustrated them with numerous examples, it may not 
be out of place to reassure those students not interested in mathematics per se that 
every one of the topics we discuss is of fundamental importance in applied mathe- 
matics, physics, and engineering. Indeed, without falsifying fact, this book could 
have been entitled “An Introduction to Applied Mathematics” or “Advanced 
Engineering Mathematics,” and might have been save that the material covered is 


of real value for the student of “pure”? mathematics too. Nevertheless, most of 


the ideas which we have treated grew out of problems encountered in classical 
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physics and the mathematical analysis of physical systems. As such these ideas lie 
at the foundations of modern physics and, to a lesser extent, modern mathe- 
matics as well. 

But even more important, the subject which we have chosen to call “Linear 

Analysis” is, when viewed as an entity, one of the most profound creations of the 
human mind, and numbers among its contributors a clear majority of the great 
mathematicians and physicists of the past three centuries. For this reason alone 
it is worthy of study, and as our discussion proceeds we can only hope that the stu- 
dent will come to appreciate the beauty and power of the mathematical ideas it 
exploits and the remarkable creativity of those who invented them. If he does, his 
efforts and ours will have been well rewarded. 
For the instructor. As its title suggests, this book is an introduction to those 
branches of mathematics based on the notion of linearity. The subject matter 
in these fields is vast, ranging all the way from differential and integral equa- 
tions and the theory of Hilbert spaces to the mathematics encountered in con- 
structing Green's functions and solving boundary-value problems in physics. Need- 
less to say, no single book can do justice to such a variety of topics, particularly 
when, as in the present case, it attempts to start at the beginning of things. Never- 
theless, it is the firm conviction of the authors that the notion of linearity which 
underlies these topics and ultimately enables them to be classified as branches of a 
single mathematical discipline can be developed in such a way that the student will 
gain a real understanding of the issues at stake. 

Since we have assumed nothing more than a knowledge of elementary calculus 
and analytic geometry, the first two chapters of the book are devoted to an exposi- 
tion of the rudiments of linear algebra, which we develop to the point where dif- 
ferential equations can be studied systematically. Anyone with a background in 
linear algebra should be able to begin at once with Chapter 3, using the first two 
chapters for reference. 

Chapters 3 through 6 constitute an introduction to the theory of ordinary linear 
differential equations comparable to that taught in most first courses on the sub- 
ject. Following the usual preliminaries, we introduce the notion of an initial-value 
problem and state the fundamental existence and uniqueness theorems for such 
problems. With these theorems as our real starting point, we proceed to show that 
the solution space of a normal ath-order homogeneous linear differential equation 
must be n-dimensional, and use this fact to obtain a complete treatment of the 
Wronskian. Then come equations with constant coefficients, solved by factoring 
the operators involved, after which we turn our attention to the method of variation 
of parameters. Here the algebraic point of view begins to pay real dividends, since 
we are in a position to see this method as a technique for inverting linear differ- 
ential operators. This leads naturally to the notion of Green’s functions and their 
associated integral operators, which we then treat in detail for initial-value prob- 
lems. These ideas arise again in Chapter 5 when we study the Laplace transform, 
and our approach is such that we are able to give an integrated treatment of what 
all too often strike the student as unrelated techniques for solving differential equa- 
tions. The sixth, and last, in this sequence of chapters extends the survey of linear 
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differential equations beyond the customary beginning course by proving the Sturm 
separation and comparison theorems and the Sonin-Polya theorem. At this point 
we anticipate our later needs by using these results to study the behavior of solu- 
tions of Bessel’s equation long before these solutions have been exhibited in series 
form. Finally, continuing in the same spirit, we introduce the method of un- 
determined coefficients for generating power series expansions of functions defined 
by equations with analytic coefficients. 

In Chapters 7 and 8 the setting changes to Euclidean spaces, and metric concepts 
are introduced for the first time. We begin by proving the standard results for 
finite dimensional spaces, and then proceed to discuss convergence in finite and 
infinite dimensional spaces. Here we introduce the notion of an orthogonal basis 
in an infinite dimensional Euclidean space together with the concept of orthogonal 
series expansions in function spaces. Our point of view is that these ideas are 
straightforward generalizations of concepts familiar from Euclidean n-space, and 
we have made every effort to present them as such. In Chapters 9 and 11, we illus- 
trate this theory by introducing several of the classical (Fourier) series of analysis, 
first relative to the trigonometric functions, and then, in succession, relative to the 
Legendre, Hermite, and Laguerre polynomials. (Chapter 10 is in the nature of a 
digression and is devoted to the study of convergence of Fourier series.) 

In Chapter 12, we pull the various threads of our story together by introducing 
two-point boundary-value problems. We define eigenvalues and eigenvectors and 
discuss the eigenvalue method for solving operator equations. As usual we begin 
with the finite dimensional case, which is reduced to a problem in elementary alge- 
bra via the characteristic equation, and then generalize to symmetric operators on 
function spaces. The question of the existence of eigenfunction bases is treated in 
a theorem (left unproved) of sufficient generality to cover the boundary-value prob- 
lems considered in the chapters which follow. We conclude this discussion by re- 
turning to the subject of Green’s functions to establish their existence and unique- 
ness for problems with unmixed boundary conditions. 

The last three chapters of the book use these results to solve boundary-value 
problems involving the wave, heat, and Laplace equations. The physical signifi- 
cance of these equations is discussed and the method of separation of variables 
is applied to reduce the problems considered to Sturm-Liouville systems which 
fall under our earlier analysis. The question of the validity of the solutions obtained 
is settled for the wave equation by appeal to earlier results on the convergence of 
Fourier series. Various forms of Laplace’s equation are then considered, and the 
elegant theory of harmonic polynomials is introduced. Finally, cylindrical regions 
make their appearance, and the Frobenius method is developed to the point where 
Bessel’s equation can be solved and orthogonal series involving Bessel functions 
constructed. 

The book ends with four appendices containing material which would have been 
unduly disruptive in the body of the text. There we provide a discussion of point- 
wise and uniform convergence which is sufficient for our needs, a brief treatment of 
determinants, and a development of vector field theory to the point where unique- 
ness theorems for boundary-value problems can be proved. 
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Having outlined what is in the book, a few words may be in order concerning 
what is not. First, this is not a text in linear algebra. Thus, even though we do 
present much of the material usually taught in a first course in linear algebra, a few 
familiar topics have been omitted as unnecessary for the analysis we had in view. 
Second, we have said nothing whatever about numerical approximations, finite 
difference equations, and the like. Here our decision was guided by the belief that 
this material properly belongs in a course on numerical analysis, and any attempt 
to introduce it here would have resulted in an unwieldy book far too large to 
appear decently in public. Finally, for similar reasons we have avoided all topics 
which require a genuinely sophisticated use of operator theory, such as integral 
equations and the Fourier transform and integral. Logically such material ought 
to appear in a course following one based on a text such as this. 

Given the modest level of preparation which we have assumed, we have made 
every effort, particularly in the earlier chapters, to motivate what we do by slow 
and careful explanations. Indeed, throughout the book we have been guided by 
the feeling that it is better to err on the side of too much explanation than too little. 
We have also tried to keep the discussion sharply in focus at all times by giving 
formal definitions of new terminology and precise statements of results being 
proved or used. For the most part, theorems stated in the text are proved on the 
spot. Those which are not comprise results whose proofs were felt to be either too 
difficult for a book at this level or unenlightening in view of our objectives. Such 
statements are usually accompanied by a reference to a proof in the literature. 

In its present form this book is sufficiently flexible to be used in one of several 

courses. For instance, Chapters 1 through 6 plus parts of 7 and 15 provide mate- 
rial for a combined course on (ordinary) differential equations and linear algebra 
at the introductory level. On the other hand, Chapters 7 through 11 are logically 
independent of everything which precedes them, save Chapter |, and can be used 
to give a course on series expansions and convergence in Euclidean spaces. By 
omitting Chapter 10 and adding Chapter 12, the first few sections of Chapter 2, 
and portions of Chapters 13 through 15, one obtains ample material for a one-se- 
mester course in boundary-value problems suitable for students who are able to 
solve elementary differential equations. Further there is more than enough mate- 
rial (though not exactly of the traditional sort) for several of those courses which 
go under the name of “engineering mathematics.” In fact, this book was written 
primarily for such courses, and was motivated by the belief (or hope) that engineers 
ultimately profit from mathematics courses only to the extent that these courses 
present an honest treatment of the ideas involved. 
For everyone. The internal.reference system used in the text works as follows: 
Items in a particular chapter are numbered consecutively as, for example, (3-1) to 
(3-100). The first numeral refers to the chapter in question, the second to the num- 
bered item within that chapter. 

Throughout the book we have followed the popular device of indicating the end 
of a formal proof by the mark Jin the belief that students derive a certain comfort 
from a clearly visible sign telling them how far they must go before they can relax. 
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As usual, sections marked with an asterisk may be omitted without courting dis- 
aster. Everything so marked 15 either a digression which the authors had not the 
strength to resist, or material of greater difficulty than that in the immediate vicinity. 

As a gesture toward scholarly respectability, we have included a short bibliog- 
raphy comprising those books which the authors personally found especially useful, 
and for the convenience of those inveterate browsers of books we have prepared 
an index of special symbols used in the text (see pp. xvi-xvii). Finally, a dia- 
gram showing the logical interdependence of the various chapters appears after 
the table of contents. 

Debts and acknowledgements. Collectively and individually the authors are in- 
debted to a large number of people who at long last can be publicly thanked: 

First, the numerous students who have used portions of this material more or 
less willingly at Dartmouth College and Indiana University over the past several 
years, and whose comments have been far more valuable than they ever imagined. 

Second, the surprisingly large number of professional colleagues whose advice 
has been sought,:sometimes unknowingly, and who have been more than gen- 
erous in answering questions and furnishing criticism. In particular, special 
thanks are due Professors H. Mirkil of Dartmouth College, G. C. Rota of Mas- 
sachusetts Institute of Technology, and M. Thompson of Indiana University, and 
also Mr. L. Zaleman, presently at M. I. T. 

And third, Mrs. Helen Hanchett of Hanover, New Hampshire, and Mrs. 
Darlene Martin of Bloomington, Indiana, for their patience, good nature, and 
unfailing accuracy in preparing typewritten versions of the manuscript too nu- 
merous to count, 

Thanks are also due, and hereby given, Dartmouth College for assistance ren- 
dered in preparing a preliminary version of the manuscript and the Addison- 
Wesley staff for seeing the book through press. 

Lastly, thanks of a very special sort to our several wives for their constant sup- 

port and encouragement as well as their equally constant insistence that we get on 
with things and finish the job. 
Conclusion. It seems to be one of the unfortunate facts of life that no mathe- 
matics book can be published free of errors. Since the present book is undoubtedly 
no exception, each of the authors would like to apologize in advance for any that 
still remain and take this opportunity to state publicly that they are the fault of the 
other three. 
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real vector spaces 


1-1 INTRODUCTION 


The Cartesian plane of analytic geometry, denoted by ®?, is one of the most 
familiar examples of what is known in mathematics as a real vector space. Each 
of its points, or vectors, is an ordered pair (x1, x2) of real numbers whose individual 
entries, x; and Χο, are called the components of that vector. Geometrically, the 
vector x = (X,, X2) may be represented by means of an arrow drawn from the 
origin of coordinates to the point (x, x2) as shown in Fig. 1-1.* 


FIGURE 1-1 FIGURE 1-2 


If x = (x1, x2) and y = (νι, yg) are any two vectors in 617, then, by definition, 
their sum is the vector 


x+y = (%1 + γι, χὰ + ya) (1-1) 


obtained by adding the corresponding components of x and y. The graphical 
interpretation of this addition is the familiar “parallelogram law,”’ which states 
that the vector x + y is the diagonal of the parallelogram formed from x and y 
(see Fig. 1-2). It follows at once from (1-1) that vector addition is both associative 


* Throughout this book we shall use boldface type (i.e., x, y, .. .) to denote vectors. 
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and commutative, namely, 
ere 2) -- (ἃ - Ye, (1-2) 
Key ya | (1-3) 


Moreover, if we let 0 denote the vector (0,0), and —x the vector (—x1, —X2) 
obtained by reflecting x = (x1, x2) across the origin, then 


x +0 = x, (1-4) 
and 


x + (—x) = 0 (1-5) 


for every x. Taken together, Eqs. (1-2) through (1-5) imply that vector addition 
behaves very much like the ordinary addition of arithmetic. 

As well as being able to add vectors in ®?, we can also form the product of a 
real number a and a vector x. The result, denoted ax, is the vector each of whose 
components is a times the corresponding component of x. Thus, if x = (x1, x), 
then 


ax = (aX 1, aXe). (1-6) 


Geometrically, this vector can be viewed as a “magnification” of x by the factor a, 
as illustrated in Fig. 1-3. 

The principal algebraic properties of 
this multiplication are the following: 


2X= (2x, 2X9) 


a(x + y) = ax + ay, (1-7) 
(a + B)x = ax + Bx, (1-8) 

(a8)x = a(6x), (1-9) 
x. (1-10) 


x= (X1,X9) 


Ix —1x=(— x ,—X9) 


The validity of each of these equations FIGURE 1-3 


can be deduced easily from the definition 

of the operations involved, and save for (1-9), which we prove by way of illustra- 
tion, the equations are left for the student to verify. To establish (1-9), let 
χ = (Xj, Χο) be an arbitrary vector in ®”, and let a and β be real numbers. Then 
by repeated use of (1-6), we have 


(a8)x 


((aB)x 1, (aB)x2) 
(a(8x 1), e(Bx2)) 
a(Bx 1, BX2) 
a(8(x1, X2)) 
a(Bx), 


I 


Ι 


which is what we wished to show. 
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The reason for calling attention to Eqs. (1-7) through (1-10) is that they, 
together with properties (1-2) through (1-5) for vector addition, are precisely 
what make ®” a real vector space. Indeed, these equations are none other than the 
axioms in the general definition of such a space, and once this definition has been 
given, the above discussion constitutes a verification of the fact that ®? is a real 
vector space. But before giving this definition, we pause to look at another 
example. 

This time we consider the set C[a, δ] consisting of all real valued, continuous 
functions defined on a closed interval [a, b] of the real line.* For reasons which 
will shortly become clear we shall call any such function a vector, and, following 
our general convention, write it in boldface type. Thus fis a vector in C[a, b]if and 
only if f is a real valued, continuous function on the interval [a, b]. 

At first sight it may seem that @[a, δ] and 6.2 have nothing in common but 
the name “real vector space.’’ However, this is one of those instances in which 
first impressions are misleading, for as we shall see, these spaces are remarkably 
similar. This similarity arises from the fact that an addition and multiplication 
by real numbers can also be defined in C[a, δ] and that these operations enjoy 
the same properties as the corresponding operations in ®?. 

Turning first to addition, let f and g be any two vectors in @[a, δ]. Then their 
sum, f + g, is defined to be the function 
(i.e., vector) whose value at any point x in 
[a, b]is the sum of the values of f and g at x 
(see Fig. 1-4). In other words, 


(f + g)(x) = [(Χ) + g(x). (1-1) 


At this point it is important to observe that 
since the sum of two continuous functions 
is continuous, this definition is meaningful 
in the sense that f + g is again a vector in FIGURE 1-4 
C[a, δ]. | 

It is now easy to verify that apart from notation and interpretation Eqs. (1-2) 
through (1-5) remain valid in @[a, δ]. In fact, 


f+@+h=¢+e8)tTh (1-12) 


and | 
f+e=e+f (1-13) 


follow immediately from (1-11), while if 0 denotes the function whose value is 


* The closed interval [a, δ] is the set of all real numbers x such that a < x < 3b; i.e., 
[a, ὁ] is the interval from a to b, end points included. By contrast, if the end points are 
not included in the interval, we speak of the open interval from a to ὁ, and write (a, δ). 

{ For a proof of this fact see, for example, C. B. Morrey, Jr., University Calculus with 
Analytic Geometry, Addison-Wesley, 1962, p. 89. 
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FIGURE 1-5 FIGURE 1-6 


zero at each point of [a, b], then 
f+0o=f (1-14) 


for every f in @[a, δ] (Fig. 1-5). Finally, if —f is the function whose value at x is 
—f(x) (i.e., —f is the reflection of f across 0, as shown in Fig. 1-6), then f + (—f) 
has the value zero at each point of [a, b], and we have 


f+ (—-f) = 0. (1-15) 


We have seen that the sum of two vectors in ®” is found by adding their cor- Ὁ 
responding components (Eq. 1-1). A similar interpretation of vector addition iS 
possible in the present example and may be achieved as follows. If f is any vector 
in C[a, b], we agree to say that the “component” of f at the point x is its functional 
value at x. Of course, every vector in C[a, δ] then has infinitely many components, 
one for each x in the interval [a, b], but once this fact has been accepted it becomes 
clear that Eq. (1-11) simply states that the sum of two vectors in C[a, δ] is obtained 
by adding corresponding “components,” just as in ®?. 

Next, if f is any vector in C[a, b] and a 
is an arbitrary real number, we define the 
product af to be the vector in C[a, δ] 
whose defining equation is 


(of)(x) = αἴ). (1-16) 


In other words, af is the function whose 
value at x is the product of the real num- 
bers a and f(x). The similarity between 
this multiplication and the corresponding 
operation in ®? is clear, since af is also 
formed by multiplying each “component” 
of f by a. (Figure 1-7 illustrates this mul- 
tiplication when a = 2.) FIGURE 1-7 
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The analogy with ®? is now complete, for Eqs. (1-7) through (1-10) are also 
valid in C[a, Ὁ]. We restate them here as 


α( + 5) = αἵ + ag, (1-17) 
(a + p)f = of + Af, (1-18) 
(o6)f = a(6f), (1-19) 

if =f, (1-20) 


and leave their proofs as an exercise. 

This is perhaps an appropriate point at which to warn the unsuspecting reader 
that the space C[a, δ] is much more.than an idle example. Indeed, a great deal of 
our later work will be devoted to a study of this and similar vector spaces, and the 
student will do well to understand it before reading further. 


EXERCISES 


In Exercises 1 through 5 compute the value of x + y and a(x + y) for the given vectors 
x and y in 612 and real number a. Illustrate each of your computations with an appro- 
priate diagram. 

1.x = (0,2), y = (-1,1), a = 3 

2.x = (4,1), y = (1, —2), a = --2 

3.x = ({-, 3), y = (-2, --1), α 

4.x = (5, —2), y = (—3,2),a = 

5.x = (—5, —2), y = (-1, —1), a = -3 
In Exercises 6 through 10 compute the value of f + g and a(f + 5) for the given vectors 
f and g in C[—1, 1] and real number a. Illustrate each of your computations with an 
appropriate diagram. 

6. f(x) = 2x, g(x) = x2? —-x4+ 1a Ξ 2 


—1 


ν»μ || 


7. f(x) = tan’ x, g(x) = 1, a = —1 

8. f(x) = εὐ, g(x) = ῥ ε΄, a = ἃ : 
x + 3 x—2 1 

9. fx) = ES, gx) - - 2a =; 

10. f(x) = cos? x, g(x) = sin? x, a = —3 


In Exercises 11 through 20 determine whether or not the indicated function belongs to 
@[—1, 1]; if it does not, state why not. 


. xt+i1 x if x>0 
11. sin 12. |x| = {x if ne 
13. tanx | 14. tan (2x + 1) 
15. In |x| ig 3: Ὁ 


x2?+3x4+2 


ό 
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1 if x>0 x—i if x>0 
17. f(x) = ΒΕ 2 = 
2 = if x <0 εὐ A) ome if x <0 
x-1 if x>0 ae 
hin See: 20. e 
Solve each of the following vector equations for x. 
21. 2x + 3(2,1) = (0,0) 22. 4x + 3x = 2(—1, 3) 
23. ( + Bx + 546,49) = 4@2,-) 24. x -- 32,1) = 4x 
Solve each of the following vector equations in C[—1, 1] for f. 
25. 2f — 1 = sec? x 26. Inf = 1 
27. εἷ =x+2 28. 2 + e-* = e* 
29. Prove Eqs. (1-2) through (1-5) and (1-7) through (1-10) of the text, and illustrate 


30. 
31. 


32. 


each with a diagram. 

Prove Eqs. (1-12) through (1-15) and (1-17) through (1-20) of the text. 

Let x be a vector in ®?, and let a be a real number. Prove that ax = 0 if and only 
[ἃ = Oorx = 0. 

Let x ~ 0 be a vector in 6,2, and suppose ax = x. Prove thata = 1. 


1-2 REAL VECTOR SPACES 


With the examples of the preceding section in mind we now give the definition 
of a real vector space. 


Definition 1-1. A real vector space © is a collection of objects called 
vectors, together with operations of addition and multiplication by real 
numbers which satisfy the following axioms. 


Axioms for addition. Given any pair of vectors x and y in U there exists a 
(unique) vector x + y in U called the sum of x and y. It is required that 
(i) addition be associative, 


x + (y + 2) (x+y) +z, 


(1) addition be commutative, 
x+ty=yrt x, 


(iii) there exist a vector 0 in Ὃ (called the zero vector) such that 


x+0O=x 
for all x in U, and 


(iv) for each x in U there exist a vector —x in Ὃ such that 


x + (—x) = 0. 
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Axioms for scalar multiplication. Given any vector x in U and any real num- 
ber a there exists a (unique) vector ax in Ὃ called the product, or 
scalar product, of a and x. It is required that 


(v) a(x + y) = ax + ay, 
(vi) (a + B)x = ox + Bx, 
(Vil) (αβ)χ = a(x), 

(vii) Ix = x. 


The student should not be discouraged by the formality of this definition; it 
looks much worse than it really is. The issue here is simply that in order to deserve 
the name, a real vector space must have a number of elementary and eminently 
reasonable properties in common with ®?. We have already seen this happen in 
the case of the function space C[a, δ], and before embarking on the general study 
of this subject we give several additional examples of such variety as to convince 
the reader that real vector spaces are very common objects indeed in mathematics. 
Still others will be found in the exercises at the end of this section. In each case 
we leave the verification of Axioms (i) through (villi) as an exercise to aid the 


_ beginner in assimilating the various requirements of the definition. 


EXAMPLE 1. The real numbers, with the ordinary definitions of addition and 
multiplication, form a real vector space. In this case Axioms (i) through (viii) 
are all familiar statements from arithmetic. 


EXAMPLE 2. Let n be a fixed positive integer, and let ®” denote the totality of 
ordered n-tuples (x1,...,Xn) of real numbers. If x = (x1,...,%,) and y = 
(1, --.+>5 Yn) are two such n-tuples, and a is a real number, set 


Se VS Oa F Vike Xa Va) (1-21) 
and 


aX = (aX1,..., Xn). (1-22) 
Then ®” becomes a real vector space. It is clear that ®’ is the vector space of 
Example 1 above, and that ®? and ®® are the vector spaces studied in analytic 
geometry. 

Note that there is nothing in the least mysterious in the fact that n is allowed to 
assume values greater than three in this example. It is true, of course, that pictures 
of the usual sort cannot then be drawn, but this is no serious shortcoming. In 
fact, geometric tmtuition from 3-space, if used circumspectly, is still reasonably 
accurate in ®” when n > 3, despite the lack of a visual representation for these 
spaces. 
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EXAMPLE 3. Let @ denote the set of all polynomials in x with real coefficients, 
and Jet polynomial addition and multiplication by real numbers be defined as in 
high school algebra. Then Ὁ 15 a real vector space. 


This completes our list of basic examples. As we shall see, each of the real 
vector spaces C[a, δ], Θ΄, and @ has distinctive features not shared by either 
of the others, and for this reason these three spaces will occupy a special place in 
our later work. And since we have already mentioned the future importance 
of C[a, δ]. it is only fair to add that ®” and Φ will in turn receive a great deal 
of attention. 

Before we continue, a few general remarks concerning the definition of a real 
vector space are in order. First, since vector addition is associative, any finite 
sum of the form 


χι + x2 +0 + Xn 


is well defined as it stands and need not be festooned with parentheses to avoid 
ambiguity. Moreover, the commutativity of vector addition implies that the value 
of such a sum does not depend upon the order of the summands. 

Secondly, in the interest of simplicity we shall write x — y from now on in 
place of the unwieldy expression x + (—y). This, of course, involves the usual 
change in terminology, for we then say that x — y is obtained by subtracting 
y from x. 

And finally, we call attention to the reasonably obvious fact that our insistence 
upon using real numbers in the definition of a vector space is quite unnecessary. 
_ Complex numbers, for instance, would do just as well, in which case we would 
have what is unsurprisingly known as a complex vector space. Even further 
generalizations are possible. However, these more general vector spaces will not 
appear in this book, and so we agree that the term “vector space’’ will always 
mean real vector space, as defined above. Furthermore, the term scalar will be 
used now and again as a synonym for the words “real number”’ in consonance 
with the standard terminology of the subject. 


EXERCISES 


1. With addition and scalar multiplication as defined in the text, prove that ®” is a real 
vector space. 
2. Prove that @ is a real vector space. (Recall that the vectors in Φ may be written in 


the form 
ago + aux - τ + anx", 
where ao, ..., @n are real numbers.) 
3. Find the value of a1x1 + aex2 + a3x3 in R? when 
(a) x1 = (2,1), x2 = (—1, 2), x3 = (1,0), a1 = 1, a2 = 2, a3 = —1; 


(b) Χι = GG, 3), x2 = (—4, 4). x3 = (—T, 2), αἵ a 2, a2 = 9, a3 = = 2; 
(Cc) x1 = (—2, 2), x2 = 


2 
(—3, == 3), x3 = (ξ, --ἢ), ai = ὦ, a2= 3, α8 Ξ 2. 
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4. Find the value of a1x1 + a2x2 + a3x3 in R* when 


(a) x1 = (2, 0, —1, 3), x2 = (1, —2, 2, 0), x3 = (2, —1, 3; 1), a1 = --ΞΙ, a2 = 0, 
az = 1: J 
(Ὁ) xi = (1, 2, 3,4), x2 = (0,2,1, —2), x3 = (2,6,7,6), αι = 2, a2 = 1, 


a3 = --; 
(c) x1 = (—3, 2,1, —3), x2 = (1, —2, ξ, 5), x3 = G, 0,0, δ), αι = —2,a2 
a3 = --ἴ. 
5. Find the value of aipi + a2p2 + a3p3 in Ὁ when 
(a) pi(x) = x? — x + 1, a1 = 2, 


ble 


po(x) = 3x? + 2x — lag = —1, 
p3(x) = —x? + 2x, a3 = —2; 
(Ὁ p(x) = 2x4 — 4x? + 1, a1 = 3, 
po(x) = —x* + 2x? + x2? —x+ 2, ae = 2, 
ps(x) = —x* + 4x3 — 2x -- 3, a3 = —1; 
(c) pi(x) = $x? — 2x? + 4, αἱ = 3, 
po(x) = 2x — 1, a2 = --, 


p3(x) = x*, ag = 2. 
6. Does the set of all polynomials in x with integral coefficients form a real vector space 
with the usual definitions of addition and multiplication by real numbers? Why? 


7. Let 6 denote the set of all complex numbers, i.e., all numbers of the form a + δὶ, 
a and ὁ real, andi = /—1. With addition of complex numbers defined by 


(α - δὴ -Ῥ (ς - αἷὴ Ξε (α -Ῥ ὦ) - ©+ di, 
and scalar multiplication defined by 
a(a + bi) = aa + abi, 


prove that Ὁ is a real vector space. Compare this space with ®2. 
8. Let R” be the set consisting of all infinite sequences 


x = (x1, X2,. ᾿ .) 


of real numbers. If y = (1, y2,...) is another such sequence, define x + y by 


x+y = (αι Τ᾿ γι: x2 + yo,...)3 


while if a is a real number, define ax by 
ax = (a@X1,aX2,...). 


Prove that ®® is a real vector space. 

9. With addition and scalar multiplication defined as in C[a, δ], determine which of the 
following sets of functions is a real vector space: 
(a) all functions which are continuous everywhere on [a, ὁ] except at a finite number 
of points; 
(Ὁ) all functions which are zero everywhere on [a, 6] except at a finite number of 
points; 
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(c) all functions which are different from zero at all but a finite number of points 
of [a, δ]; 
(4) all continuous functions such that f(a) = f(5); 
(6) all continuous functions such that f(a + x) = f(b — x); 
(f) all continuous functions which are zero on some closed subinterval of [a, 5]; 
(g) all continuous functions which are zero on a fixed subinterval of [a, δ]. 
10. Let ®t be the set consisting of all positive real numbers, and define ‘‘addition”’ and 


“scalar multiplication” in Rt as follows: If x and y belong to Rt, let 
x+y = xy, 


where the product appearing on the right-hand side of this equality is the ordinary 
product of the real numbers x and y; if α is an arbitrary real number, let 


Prove that ®t is then a real vector space. 


11. Let U be the set of all ordered pairs of real numbers. Ifx = (x1, x2)andy = (1, y2) 
are any two elements in U, define 


» Τ' γ..-- (x1 + y1, 9), 


and let scalar multiplication be defined as in R?. Is Ὃ a real vector space? Why? 


12. Repeat Exercise 11, this time with addition defined as in 612 and scalar multiplication 
changed to 
ax = (x1, 0). 


13. Use the associativity of vector addition to prove that 
Wwtx+y+z=wt (ἃ ἘΥ Ὁ 2). 


14. Is the operation of subtraction in a vector space associative or commutative? 


1-3 ELEMENTARY OBSERVATIONS 


In this section we note a number of immediate consequences of Définition 1-1, 
all of which are so elementary that they will be used without explicit mention in 
the future. The first of these concerns the zero vector and asserts that this vector 
behaves very much as one might expect. Specifically, 


Ox = 0 for every x, (1-23) 
and 
a0 = 0 for every a. (1-24) 


To prove the first of these assertions set a = 8 = Oinax + 6x = (a + B)x. 
This gives 
Ox + Ox = (0 + O)x = Ox. 


Now subtract Ox from both sides of this equation, and then use the fact that 


1-3 ELEMENTARY OBSERVATIONS 11 


Ox — Ox = 0 to obtain 
Ox + (Ox — Ox) = Ox — Ox 
and 
Ox + 0 = 0. 

Hence Ox = 0. 

The proof of (1-24) is similar; this time set x = y = Oina(x+ y) = ax + ay. 

Next, an equally elementary proof establishes the fact that the vector —x and 
(— 1)x are one and the same. Indeed, since 1x = x and Ox = 0, we have 


x + (—Dx = Ix + (-Dx = ( — Dx = Ox = 0. 


Now subtract x from both sides of this equation to obtain (—1)x = —x, as 
asserted. 

Finally, it may be of interest to prove that in any vector space VU the vector 0 is 
unique and —x is uniquely determined by x, in the sense that they are the only 
vectors in U possessing their particular properties. This is the burden of 


Lemma 1-1. Jf 0’ is a vector in Ὃ such that x + 0’ = x for every x in VD, 
then 0’ = 0. Similarly, if x’ is any vector in © such that x + x’ = 0, 
then x’ = —x. 


Proof. If x + 0’ = x for every x in U, we have, in particular, 
0+ 0 = 0. 


On the other hand, the zero vector has the property that 0 + x = x for every x. 
Hence : 


0+ 0’ = 0, 
and it follows that 
0= 0. 


The second statement of the lemma follows from the sequence of equalities 


xX = 04x = (-x4+x)+ x = -x4+ 44+ x) = -x+0= -x.] 


EXERCISES* 


1. Prove that ax = 0 implies that a = 0 or x = 0. [This is the converse of (1-23) 
and (1-24).] 

2. Prove that ax = $x if and only if either x = Oora = 8. 

3. Establish the equality (—a)x = —(ex) for any a and any x. 


* Exercises marked with an asterisk are intended to be somewhat more challenging 
than the rest. 
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*4. Prove that the commutativity of addition in a vector space is a consequence of the 
remaining axioms, as follows: | 
(a) Use Axioms (i), (iii), and (iv) to prove that x + z = y + z implies x = y. 
(This result is sometimes known as the Cancellation law of vector addition.) 
(b) Justify each step in the following sequence of equalities: 


(+ x) + (—x) = 0+ k+ (—-x)) = 0+0=x+ (—x). 


Now apply (a) to show that 0 + x = x for all x in Ὁ. 


(c) With the aid of the result just proved, justify each step in the following sequence 
of equalities: 


[((—x) + x] + (—x) = (—x) + [k + (-x)] = -x +0 = —-x = 0+ (—x). 


Now apply (a) to show that —x + x = 0 for all x in VD. 

(4) Use (Ὁ) and (c) to prove that z + x = z + y implies x = y. 

(e) Use Axioms (v) and (vi) of Definition 1-1 to expand (1 + 1)(χ + y) in two 
ways, and then apply (a) and (d) to deduce that x + y = y + x for all x and y. 


1-4 SUBSPACES 


Now that we are well armed with examples, we begin the systematic study of 
real vector spaces. To do so, we introduce the important notion of a subspace of 
a vector space. | 


Definition 1-2. A subset W of a vector space Ὃ is said to be a subspace 
of Ὁ if W itself is a vector space under the operations of addition and scalar 
multiplication defined in Ὁ. 


Before giving examples, we consider the problem of determining when a given 
collection of vectors actually is a subspace. One way of doing this, of course, is 
to verify that the set of vectors in question satisfies all of the requirements of 
Definition 1-1. However, the step by step verification of the axioms in this defi- 
nition is both time consuming and tedious, and we now show how this procedure 
can be substantially shortened. Specifically, we establish the following: 


Subspace Criterion. Jf every vector of the form 
1X1 + aXe (1-25) 


belongs to Ὃ whenever x1 and Χο belong to‘W, and a, and ag are arbitrary scalars, 
then WW is a subspace of Ὅ. 


+ The term “subset” as used here and in similar contexts in the future means that every 
vector in W also belongs to U. Moreover, we always assume that there is at least one 
vector in W—a fact which is sometimes expressed by saying that W is nonempty. 
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To prove this assertion, we must show that W satisfies Definition 1-1. But by 
first setting αἱ = a, = | in (1-25), and then setting a, = 0, we deduce in turn 
that (a) the sum of any two vectors in W again belongs to Ἂν), and (Ὁ) ax belongs 
to ‘Ww for every real number a and every x in W.* 

From (b) it follows in particular that —x belongs to W whenever x does, and that 
(Ὁ) also contains the zero vector. Thus W satisfies Axioms (iii) and (iv) of Defini- 
tion 1-1. Finally, we observe that the remaining axioms certainly hold in ἍΝ, 
since they are valid everywhere in ©. Hence W is a subspace of Ὁ. ἢ 


EXAMPLE 1. Every vector space has two subspaces: (a) the whole space, and 
(b) the subspace consisting of the zero vector by itself, called the trivial subspace. 
A subspace of U which is distinct from Ὃ is called a proper subspace. 


EXAMPLE 2. If ‘W is the subset of ®® consisting of all those vectors whose third 
component is zero, then the above criterion implies at once that ‘W is a subspace 
of 6.15. When the components of each vector in 61" are viewed as its ordinary 
x, y, z-components, then W is just the (x, y)-plane in 3-space. 


EXAMPLE 3. Let ΘἾ[α, b] denote the set of all functions which possess a continuous 
derivative at every point of the interval [a, b]; i.e., the so-called continuously 
differentiable functions on [a, δ]. Since a differentiable function is continuous, 
each function in Ὁ ἴα, b] also belongs to C[a, δ]. But both the scalar multiple of 
a continuously differentiable function and the sum of two such functions are 
continuously differentiable. Hence @'[a, δ] is closed under addition and scalar 
multiplication and thus is a subspace of @[a, b]. More generally, if C”[a, δ] denotes 
the set of all n times continuously differentiable functions on [a, b], then C”[a, δ] 
is a subspace of @"[a, δ] whenever m > ἢ. 


EXAMPLE 4. Let @,, be the set consisting of all polynomials of the form 
Ag + ayx +e + Gy x", 


where @o,..., G,—, are arbitrary real numbers, and n is a fixed positive integer ; 
i.e., ®, consists of all polynomials with real coefficients of degree <n, together 
with the zero polynomial. Then @, is a subspace of @ and also of Φ,, whenever 
m > n. 


Now that we know what a subspace is, it is natural to ask how one might go 
about finding all subspaces of a given vector space. In general, this is a hard 
problem, but for certain spaces the answer can readily be given. For instance, 
it is not difficult to show that the only nontrivial, proper subspaces of ®® are lines 
and planes through the origin (see Exercise 4, below). And once this observation 


* Mathematicians summarize these two facts by saying that ἊΝ is closed under vector 
addition and scalar multiplication. In this language the above criterion becomes the 
statement that a nonempty subset of a vector space is a subspace if and only if it is closed 
under vector addition and scalar multiplication. 
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has been made one is struck by the fact that the intersection of any two subspaces 
of ®® is again a subspace of ®*. Actually, this is true in general, as is shown in 


Lemma 1-2. Jf δι and Wz. are subspaces of Ὃ, then the set consisting 
of all vectors belonging to both δι and ‘W 4 is a subspace of V. 


Proof. Let W be the set in question, and note that W contains the zero vector 
since this vector belongs to both W ; and W.. Now let x; and x» be any two vectors 
in W. Then x, and xg belong to W, and to Ἂν... and hence so does αἰΧ| + aoXe 
for any pair of real numbers a; and ag. This implies that a,x; + a2X2 belongs 
to ἍΝ, and the assertion that Ὃν is a subspace of U now follows from the subspace 
criterion. ἢ 


The subspace ‘W of this lemma is known as the intersection of W , and Wo, and 
is denoted W, NM We (read ““W, intersect W,”’). 

We now return to the problem of finding all subspaces of an arbitrary vector 
space U. Rather than attempt a frontal assault on this problem, it turns out to 
be much more profitable to proceed as follows: Let X be any (nonempty) subset 
of U. Then, as was noted above, there is at least one subspace of U containing δ, 
namely Ὃ itself. This being so, we attempt to find the “‘smallest’’ subspace of U 
containing 9%, where by this we mean that subspace of Ὃ which contains X, and 
which in turn is contained in every subspace of © containing X. To show that 
such a subspace actually exists, consider the totality of all subspaces of Ὃ which 
contain ἃ, and let $(X) denote the set of vectors belonging to every one of these 
subspaces; 1.6., $(9C) is the intersection of these subspaces. Reasoning as in the proof 
of Lemma 1-2, we see that $(9) is a subspace of Ὃ, and from its very definition it 1s 
clear that there is no subspace of © which contains X and is properly contained in 
§(X). Thus S(%) is the desired subspace. It is called the subspace of U spanned 
by ἃ and, as we shall see, is uniquely determined by the set ἃ. 

All this is well and good, but unless we can discover an easy method for finding 
S(X) in terms of the vectors belonging to 9X, we will have made little progress on 
the problem of surveying the subspaces of 0. Fortunately (and this is the reason 
for introducing S() in the first place) such a method is easy to derive. To do so, 
we introduce the following definition. 


Definition 1-3. An expression of the form 
αἰχι + τ΄ τ ApXn, ((-26) 


where aj,...,a@, are real numbers, is called a linear combination of the 
vectors X1,..., Xn. 


And now we can describe S(X): it is the set of all linear combinations of the vectors 
in X. Thus once & is known, so is 8(%), and (1-26) gives the form of each of its 
vectors. 
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Y= a 1X; + aX 


S8(Xj,X9) 


a“ 
σ 
ΣΧ) -. 
~ 


-ς 


FIGURE 1-8 


Before proving this assertion, let us look at some examples in ®*. First let 2X 
consist of a single nonzero vector x. Then S(X) is the line through the origin 
determined by x. But the points on this line are simply all scalar multiples ax 
of x, and our assertion holds in this case. Next, let X consist of two nonzero, 
noncollinear vectors, x; and x2. In this case, $(X) is the plane through the origin 
determined by x; and xy. (Why?) But every linear combination of the form 
a@1X1 + a X¢ certainly lies in this plane, and, conversely, we can “reach” any 
vector y in this plane by a linear combination of x, and xg, as indicated in Fig. 1-8. 
Thus S(X) is again the set of all linear combinations of the vectors in X. 

We now prove the general result. 


Theorem 1-1. Let X be a (nonempty) subset of a vector space ©. Then 
the subspace of Ὃ spanned by & consists of all linear combinations of the 
vectors in X. 


Proof. In the first place, the set of all linear combinations of vectors in δ is closed 
under addition and scalar multiplication, and hence is a subspace W of Ὁ. More- 
over, the equation x = 1x shows that each x in & is a linear combination of 
vectors in &, thus proving that δ is contained in‘W. Finally, every subspace of Ὁ 
which contains X must contain all vectors of the form (1-26) by virtue of the fact 
that a subspace is closed under addition and scalar multiplication. In other 
words, Ὃν is contained in every subspace of U containing X, and it follows that 
ww = S(X). I 


EXERCISES 


1. Determine which of the following subsets are subspaces of the indicated vector space. 
Give reasons for your answers. 


(a) The set of all vectors in R? of the form x = (1, x2). 


(Ὁ) The zero vector together with all vectors x = (x1, x2) in 612 for which x2/x, 
has a constant value. 
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(c) The set of all vectors x = (x1, X2, x3) in R? for which x1 + x2 + x3 = 0. | 
(d) The set of all vectors in ®? of the form (x1, x2, x1 + 2). 
(e) The set of all vectors x = (x1, x2, x3) in R3 for which xf + x$ + x3 = 1. 


. Repeat Exercise 1 for the following subsets. 


(a) The subset of @, consisting of the zero polynomial and all polynomials of 
degree n — 1. 

(b) The subset of Φ consisting of the zero polynomial and all polynomials of 
even degree. 

(c) The subset of @ consisting of the zero polynomial and all polynomials of 
degree 0. 

(4) The subset of @,, n > 1, consisting of all polynomials which have x as a 
factor. 

(ὁ) The subset of & consisting of all polynomials which have x — 1 as a factor. 


. Repeat Exercise 1 for the following subsets of C[a, δ]. 


(a) The set of all functions in C[a, δ] which vanish at the point xo in [a, δ]. 
(Ὁ) The set of all nondecreasing functions in C[a, δ]. 

(c) The set of all constant functions in C[a, 5]. 

(4) The set of all functions f in C[a, δ] such that f(@) = 1. 

(e) The set of all functions f in C[a, δ] such that [ὦ f(x) dx = 0. 


. Prove that the only proper subspaces of 618 different from the trivial subspace are 


lines and planes through the origin. 


. Prove that @, is a subspace of 6. 
. Consider the set of all infinite sequences {x1,..., Xn,...} Of real numbers which 


have only a finite number of nonzero entries. Prove that this set is a subspace of the 
vector space defined in Exercise 8 of Section 1-2. 


_ Determine which of the following vectors belong to the subspace of 615 spanned 
by (1, 2, 1) and (2, 3, 4). 
(a) (4, 7, 6) (c) G1, 1) (6) @, 9, 4) 


. Determine which of the following vectors belong to the subspace of ®? spanned 
by (1, —3, 2) and (0, 4, 1). 
(a) (3, —1, 8) (c) G, 1, 3) (0) (, —-1,3 
(Ὁ) (2, —2, 1) (ὦ (2, —§, 0) ὦ , 3, —9) 


. Determine which of the following polynomials belongs to the subspace of @ spanned 
by x3 + 2x? + 1, x? — 2, χϑ + x. 
(a) x2 —~x +3 (c) 4x? — 3x 4+ 5 (ec) --χϑ + 3x7 -—x- 1 
(Ὁ) x? — 2x + 1 (ὦ x* + 1 (Ὁ x — 5 


Let f and g be the functions in C[0, 1] defined by 


_jO if O< x < §%, QS 
κὸ τὶ ἢ if $< x <1, 0 = | if ἐξ χα Ξ 1. 


Find S(f), $(g), and S@, g). 


11. 


12. 


13. 


14. 


15. 


16. 


17. 


18. 


19. 


20. 


21. 


22. 
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Let f be the function whose value is 1 at every point of the interval [α, 6]. Find the 
subspace of C[a, δ] spanned by f. 

Find the subspace of ®® spanned by each of the following sets of vectors. 

(a) (2,1, 3), (—1, 2, 1) 

(b) (1, 0, 2), (2, 1, —2) 

(c) (—1, 1, 2), (0,1, 0), (2, 4, 1) 

Find the subspace of Φ spanned by each of the following sets of vectors. 

(a) x?, x(x + 1) 

(Ὁ) x + 1, x? — 1 

(c) 1, x — 2, (x — 2)? 

Prove that the intersection of any collection of subspaces of a vector space VU is a 
subspace of U. (By the intersection of a collection of subspaces of Ὃ we mean the 
totality of vectors common to all of the subspaces in question.) 

(a) Prove that S(S(9)) = S(%) for any X. 

(Ὁ) Prove that $(X°) = ἃ if and only if X is a subspace of VU. 

Let Wi, We, and Ws: be subspaces of a vector space, and suppose that Wj is.a 
subspace of Wo, and that W 2 is a subspace of W3. Prove that W is a subspace of 
W 3. 

Let X1 and XN2 be two sets of vectors in U, and let X1 MN Ne be the set of vectors 
belonging to X1 and Xo. Furthermore, let us agree that if 1 and X2 have no vectors 
in common, (1 M Xz) 15 the trivial subspace of U. Show that 8(%1 NM Xe) isa 
subspace of $(%1) MN S(X2). Give an example in R? where these two subspaces are 
distinct, and one where they are identical. 

Prove that the following two subsets span the same subspace of 68. 

(a) (4, —1, 2), (3, 0, 1) 

(Ὁ) (-—1, —2, 3), G, 3, —4 

Prove that the functions sin? x, cos? x, sin x cos x span the same subspace of 
C[a, δ] as 1 sin 2x and cos 2x. 

Let W1 and We be subspaces of U, and let W denote the set of all vectors which 
belong to Wy 1 or We, or both. Prove that W is a subspace of Ὃ if and only if one 
of the W,; (i = 1, 2) is contained in the other. 

(a) Let δῇ 1 be the subset of C[—a, a] consisting of all functions f such that f(x) = 
f(— x), and let W 2 be the subset consisting of all f such that f(x) = —f(—x). Prove 
that W 1 and W 2 are subspaces of C[—a, a]. 

(b) Give a graphical description of the functions belonging to each of these sub- 
spaces. 

(c) What is W1 ὦ Wo? 

(d) Prove that every vector f in C[—a, a] can be written in one and only one way as 
a sum of a vector in Wy, and a vector in We. ([Hint: Consider the functions 
(f(x) + f(—x))/2 and ((Ὁ — f(—x))/2.] 

Let W 1 and W 2 be subspaces of U, and let W1 + We be the set of all vectors in U 
of the form x; + Χο, where x; belongs toW and x2 toWe. Show thatW1 + We 
is a subspace of Ὁ. 


23. 


24, 


25. 


26. 


27. 


*28. 
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Let ‘W be the subset of @, consisting of all polynomials which have zero as a root, 
and let We be the subset of Φ, consisting of the zero polynomial and all poly- 
nomials of degree zero (i.e., constant polynomials). Prove that ®, = Wi + We 
(see Exercise 22), and show that each vector in @,, can be written in one and only 
one way as the sum of a vector in W, and a vector in We. 


If X1 and Xe are two sets of vectors in VU, then X1 U Loe (read “41 union X2”’) 
is the set of vectors belonging to 1 or to Xe (or both). Prove that 
δία, ὦ Lo) = S(L1) + δ( 2), 


and illustrate this result by examples chosen from ®® (see Exercise 22). 
Let a; and a2 be real numbers and consider the linear equation 


a1X1 + agxg = 0 


in the unknowns x; and x2. A vector (c1, c2) of R? is said to be a solution of this 
equation if the substitution of οι and ce for x; and x2 respectively reduces this 
equation to an identity. Show that the set of solutions of the given equation is a 
subspace of 612. Describe this subspace graphically. 


Show that the set of all simultaneous solutions of the pair of linear equations 
1X1 + aexeg = 0 and B1x1 + Boxe = 0 
is a subspace of 612, and give a geometric description of this subspace. 
(a) Suppose that the vector x = (c1, c2) is a solution of the pair of linear equations 
a1X1 + αῶχῷ = 711, 


B1x1 + Boxe = Yo. 


Prove that every solution of this pair of equations is of the form x + y, where y is 
a solution of 


ω 


Ι 


αιχι + aex2g = 0, 
Bix1 + Boxe = 0. 


(b) Conversely, with x and y as in (a), prove that every vector of the form x + y 
is a solution of (1). 

(c) Give a geometric description of the solutions of (II), and then use it and the 
above results to obtain a description of the solutions of (1). 

Let X be an arbitrary subset of a vector space VU, and let x and y be vectors in VU. 
Suppose that x belongs to the subspace S(X, y) but not to $(%). Prove that y then 
belongs to S(X, x). (This result is sometimes known as the exchange principle.) 


(If) 
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Consider the subspace 8(x 1, X2, X3) spanned by three nonzero, coplanar vectors 
in 6.3, no two of which are collinear (Fig. 1-9). ‘In this case it is perfectly clear 
that the given set contains more vectors than are needed to span the plane 
$(x1, Χο, X3), Since any two of them suffice in this respect. But at least two vectors 
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are always necessary to span a plane in 6ιὅ, and hence we obtain a “minimal” 
subset of x1, Χο, X3 which spans $(x1, Χο, X3) by discarding any one of the given 
vectors. This example suggests that it may be possible to reduce any finite set 
of vectors X1,..., X, to a minimal subset which continues to span S(X1,..., Xn). 
This is in fact the case, as we show in Theorem 1-2, but before doing so we intro- 
duce some useful terminology. 


Definition 1-4. A vector x is said to be Jinearly dependent on x1,..., Xn 
if x can be written in the form 


Χ = aX, + °° + aynXy, 


where the a; are scalars. If, on the other hand, no such relation exists, 
x is said to be Jinearly independent of x,,..., Xn- 


Thus x is linearly dependent on x,,..., X, if and only if x is a linear combination 
of X1,...,X» (Definition 1-3), and hence if and only if x belongs to the subspace 
spanned by them (Theorem 1-1). In particular, each of the vectors x;, 1 <i <n, 
is linearly dependent on x;,..., Χρ; since it belongs to the subspace spanned by 
these vectors. We also note that the equation 0 = Ox implies that the zero vector 
is linearly dependent on every vector. 


FIGURE 1-9 


It is convenient to extend the terminology of Definition 1-4 to include finite 
sets of vectors by saying that such a set is linearly independent if no one of its 
vectors is linearly dependent on the remaining ones. If this is not the case, we say 
that the set is Jinearly dependent. Finally, when referring to a linearly independent 
(or dependent) set xj,...,X,, we shall often relax our terminology and say that 
the vectors themselves are linearly independent (or dependent). 

How does one determine in practice whether a set of vectors is linearly dependent 
or independent? The easiest method is given by the following test for linear in- 
dependence. 
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Test for linear independence. The vectors x1,...,Xn are linearly independent 
if and only if the equation 
OQ yX4 + ses + AnXkyn = 0 


implies that a, = +** = a, = 0. 


For instance, x; = (1,3, —1,2), x2 = (2,0,1,3), xs = (—1,1,0,0) are 
linearly independent in ®* since the equation 


@1X1 + aXe + a3x3 = 0 
implies that 


αι + 2a2 — ag = 0, 
3a + ag = 0, 
—a;, + ae = Q, 
2a, + 3a = 0, 


from which it easily follows that aj = ag = a3 = 0. 

We leave the proof of the above test as an exercise (see Exercise 9 below), 
with the strong recommendation that it be done. 

And now we are ready to show how one can weed the extraneous vectors from 
any finite set x;,...,X, without disturbing 8(x1,...,X,). The basic idea is 
obvious; just get rid of as many linearly dependent vectors as possible. 

To accomplish this we begin with the vector x,. If x, 1s linearly dependent on 
Xi1,---, Xn—1, then 

Xn = αἰΧχὶ Γ᾿ + Gn—1Xn-1, 


and we can rewrite the expression 
KX = BiX1 - τ + BnXn 
for an arbitrary vector in S(x1,..., Xn) in the form 


x = (B14 ΞΕ a1Bn)X1 ἘΣ ἢ (Bn—1 ΞΕ On—1Bn)Xn—1- 


This proves that x is already a linear combination of x1,..., X,—1, and hence 
that S(x1,...,Xn—1) = 8(X1,..-.,Xn). In this case we drop the vector x, from 
the set x,,...,Xn. If, on the other hand, x, is not linearly dependent on 
X1,--., Xn—1, we keep it. 

If we repeat this procedure with each of the x; in turn, dropping x; if it is linearly 
dependent on the remaining vectors in the (possibly modified) set, keeping it 
otherwise, it is clear that we obtain a linearly independent subset of x1,..., Xn 
which spans the subspace 8(x;,..., Xn). This, of course, is what we started out 
to show, and we have proved 


Theorem 1-2. Every finite set of vectors X contains a linearly independent 
subset which spans the subspace 8(X). 
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(Note, however, that in general X contains many such subsets. This was the case 
for instance in the example given at the beginning of this section. Other examples 
will be found in the exercises below.) | 

Linearly inflependent sets enjoy a special status in the study of vector spaces, 
and among such sets those which span the entire space are particularly important. 
Such sets are named in 


Definition 1~5. A finite linearly independent subset @ of a vector space U 
is said to be a basis for Ὃ if 8(@) = Ὁ. 


As an example, we cite the vectors i = (1,0,0), j = (0, 1,0), k = (0,0, 1), 
which form a basis for σι. We shall prove this assertion in Example 1 below, and 
now merely wish to observe that every vector x = (x1, χω, X3) in ®* can be written 
in one and only one way as a linear combination of these basis vectors, namely, 
X = χιὶ + Χο] + x3k. This last property actually serves to characterize a basis 
in a vector space, as we now show. 


Theorem 1-3. A set of vectors e€1,..., θη is a basis for a vector space Ὃ 
if and only if every vector in Ὃ can be written uniquely as a linear combination 
of @1,-.-3€n- 


Proof. First suppose that e;,...,€, is a basis for U. Then the 6; span U, and 
hence every vector in U can be written in at least one way as 


X = aye) + *°* + ann. (1-27) 
To show that this is the only such expression possible, let 
xX = Bie, +°°-+ + Bren (1-28) 
be another. Then, subtracting (1-28) from (1-27), we obtain 
0 = (a1 — Biler + τ΄“ + (Qn — Bren. (1-29) 


But since e;, ..., €, is a basis for VU, these vectors are linearly independent. Hence, 
by our test for linear independence, each of the coefficients in (1-29) is zero, 
and it follows that a; = B,,...,an = Bn, as desired. 

Conversely, suppose every vector in Ὃ can be written uniquely as a linear com- 
bination of e;,...,€,. Then these vectors certainly span U, and we need only 
prove their linear independence in order to show that they are a basis for 0. To 
accomplish this, we observe that 0 = Oe, + τ“ + Oe, and that our assumption 
concerning the uniqueness of such expressions implies that this is the only represen- 
tation of 0 as a linear combination of e;,...,¢€,. Thusif α161 +:-- + a,e, = 0, 
we must have αἱ = -:: = a, = O, and the test for linear independence now 
applies. J 
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EXAMPLE 1. The vectors 


61. = (1,0,..., 0), 


65 = (0,1,...,0), 


e, = (0,0,...,1) 


are a basis for ®”, since x = xe; + °°: + Xne, is the only way of expressing 
the vector x = (x;,...,X,) asa linear combination of e;,...,€,. This particular 
basis is called the standard basis for @”. 


EXAMPLE 2. Again in &”, let 


@ 
μον 
Ι 


(1,0,...,0), 
e2 ἘΠ (, τσ) 


en = Ly Dien ag); 


where, in general, e; is the n-tuple having 1’s in the first i places and 0’s there- 
after. Then ej,...,e, is a basis for ®”. To prove this let x = (x,..., Xn) 
be given, and let us attempt to find real numbers aj,...,a, such that 
X = aye; + °°: + ane,. In order that such an equality hold we must have 


ἰχγρώνν: Χο) ai(1,0,...,0)  αφ(,1,....,0) + ‘>> + a,(1,1,..., 1) 
(a1,0,...,0) + (@2g, ao,...,0) + τ + (Qn; ans... 9 On) 


= (αι + ao  Ἔ an, ao + °°* + a, cee » An), 


I 


which leads to the system of equations 


αι + α ἜΤ On = Xi, 


ag ttt + On = Xe, 
Oy = Xp. 
Hence 
αι = Xx — Xa, 
a2 = X2 — X38, 


An—1 = Xn—-1 — Xn» 
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which simultaneously shows that x can be written as a linear combination of 
e;,...,e,, and that the coefficients of this relation are uniquely determined. 
Thus the οἱ are a basis for ®”, as asserted. 


EXAMPLE 3. The polynomials 1, x, x”,...,x”—* form a basis for the vector 
space @, since each polynomial in this space can be written in one and only one 
way in the form dy + ayx - τ + Gy_yx”!. 


EXAMPLE 4. Let p(x), ..., pn(x) be any finite set of polynomials in @, and let ὦ 
be the maximum of the degrees of the p,;(x). Then no linear combination of these 
polynomials is of degree greater than d, from which it follows that p;(x), ..., Pn(x) 
is not a basis for Φ, since @ contains polynomials of arbitrarily high degree. Thus 
Φ does not possess a basis in the sense of Definition 1-5. 


In Examples 1 and 2 we exhibited two distinct bases for ®”, and in each case 
found that the total number of vectors involved was the same. This was no 
coincidence, for it can be shown that any two bases in a vector space U always 
have the same number of elements. In other words, the number of vectors in a 
basis for Ὃ (provided Ὃ has a basis) is an intrinsic property of Ὃ itself. We shall 
prove this important result in Section 7, along with certain other facts about bases 
in vector spaces, and mention it here only in order to justify the following 
definition. 


Definition 1-6. A vector space is said to be of dimension n if it has a basis 
consisting of n vectors, and is said to be infinite dimensional otherwise.* We 
denote the fact that U is n-dimensional by writing dim U = n. 


On the strength of the above examples we can assert that both ®” and Φ, are n- 
dimensional, and that Φ is infinite dimensional. 


EXERCISES 


1. Find all linearly independent subsets of the following sets of vectors in ®?. 
(a) (1, 0, 0), (0, 1, 0), (0, 0, 1), (2, 3, 5) 
(Ὁ) (1,1, 1), ©, 1,1), (0,0, 1), (6, 4, 7) 
(c) (1,1, 1), (2, 2,2), C1, 0, 0), (0,0, 1) 
(d) (0,0, 0), (4, 2,1), (4, 3, 3), (4, 4, 6) 

2. Find all linearly independent subsets of the following sets of vectors in @4. 
(a) 1,χ — 1, x? + 2x + 1, x? (Ὁ) x(x — 1), x3, 2x? — x?,x 
(c) 2x,x? + 1,x + 1,x? —1 (d) 1, x, x7, x8, x? ++ x + 1 


* By convention, the vector space consisting of just the zero vector is assigned di- 
mension 0. 
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*11. 


*12. 


=13. 


14, 


15. 
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. Are the vectors (0, 2, —1), (0, 4, —4), (0, 2, —4) linearly independent in ®?? If 


not, find a linearly independent subset which has a maximum number of elements. 


. Prove that each of the following sets of vectors is a basis for R?. 


(a) (4, 9), ©, --1} 
(b) (cos 0, sin 6), (—sin 0, cos 6), O < @ < 27 
(c) (a, 0), (0, 8), a, 8B nonzero real numbers 


(d) (4, 1), ©, 1) 


. Express each of the following vectors in ®? as a linear combination of the vectors 


in the various bases of Exercise 4: 
i, j, i+ j, oi + #4. 
[Recall that i = (1,0) andj = (0, 1).] 


. Prove that each of the following sets of vectors is a basis for ®4. 


(a) (4.0, 0, 0), (0, 1, 0, 0), (0,0, 1,0), (1, 1, 1, 1) 

(Ὁ) (1, 1, 0, 0), (0, 0, 1,1), (—1, 0, 1, 1), (0, —1, 0, 1) 

(c) (2, -1, 0, 1), C1, 3, 2,0), (0, —1, —1, 0), (—2, 1, 2, 1) 
(d) (4, —1, 2,0), (1, 1, 2,0), G, 0,0, 1), (2,1, —1, 0) 


. Express (2, —2, 1, 3) as a linear combination of the vectors in the various bases of 


Exercise 6. 


. (a) Show that the functions 1, sin? x, cos? x are linearly dependent in C[—z, π]. 


(Ὁ) Show that the functions 1, cos x, cos 2x are linearly independent in C[—z, 7]. 


. Prove that the vectors x1, .. . , X, are linearly independent if and only if the equation 


aiXi +°'+ + anx, = 0 


implies thata, = “᾿᾿ = a, = 0. 
. Prove that the vectors (a, δ) and (c, d) are linearly independent in 612 if and only if 
ad — δὲ # 0. 


Prove that the vectors (x1, x2, X3), (σι, ¥2, 3), (21, Z2, Z3) are linearly independent 
in 4.8 if and only if 


X1 Yl 21 
X2 Y2 22) x 0. 
X3 Y3 23 


Show that the functions sin x, sin 2x, ... , sin nx are linearly independent in C[—7z, 7] 
for any positive integer n. [Hint: Let Σ κα ακ sinkx = 0; multiply by sin jx, where 
j = 1,...,x, and integrate from —7z to 7.] Ἢ 

Show that the functions 1, sin x, cos x, sin 2x, cos 2x,... , sin nx, cos nx are linearly 
independent in C[—7z, 7]. [Hint: See Exercise 12.] 

Prove that the polynomials 


3 1 5 3 
1, x, $x? — 3, ὅχ" — 5x 
form a basis for @4. 


Express x? and x? as linear combinations of the basis vectors for @4 given in 
Exercise 14. 


16. 


17. 


18. 
19. 


*20. 


21. 


Ἐ22) 


23. 


24. 


25. 


26. 


527, 


1-5 | LINEAR DEPENDENCE AND INDEPENDENCE; BASES 25 


Assume that x1, Χο, and x3 are linearly independent vectors in U. Prove that 
ΧΙ + Xo, ΧΙ - X3, and x2 + x3 are linearly independent. 


Prove that the functions 1, e*, e?” are linearly independent in C[0, 1]. [Hint: Differ- 
entiate the expression a + Be* + Ye?" = 0.] 


Prove that the functions 1, e”, xe” are linearly independent in C0, 1]. 


Show that the polynomials 
i, x — @, (x mae a)”, cy (x va a)"—}, 


where a is an arbitrary real number, form a basis for @,. [Hint: Consider the 
Taylor series expansion of a polynomial about the point x = a.] 


Show that the polynomials 
1, x, x(x — 1), x -- D)& — 2), ..., χα -- D& — 2)°°-:-@—znz4+) 


form a basis for @,41. [Hint: Use mathematical induction.] 


Express the polynomials x? and x? + 3x — 1 as linear combinations of the basis 
vectors in @4 described in Exercise 20. 


Let X, be any set of m polynomials in @,, one of each degree 0,1,...,” — 1. 
Prove that X, is a basis for @,. [Hint: Use mathematical induction. ] 


Let X4 be the basis for @4 consisting of the cubic polynomial x? + 2x + 5 and 
its first three derivatives (see Exercise 22). Write each of the following polynomials 
Ἃ is a as a linear combination of polynomials in %4. 

(a) χϑ + 2x + 5 

(Ὁ) x? + 1 

(c) 2x? — x? + 10x + 2 


Let X be a finite linearly independent subset of a vector space U, and suppose that 
every finite subset of 0 which properly contains ὃ is linearly dependent. Prove that 
οὐ is a basis for VU. 


Let X be a finite subset of a vector.space Ὃ which spans VU, and suppose that no 
proper subset of X spans U. Prove that X is a basis for VU. 


Let e1,...,@n be a basis for U. Prove that 61. ae; + e2,...,ae; + e, is alsoa 
basis for © for every real number a. 


Prove that every basis for 618 contains exactly three vectors. [Hint: Lete1,...,€n 
be any basis in ®?, and express each e; as a linear combination of the standard 
basis vectors i, j, k as 


61 = aii + aoai1j + a3ik, 
@€2 = αιτοὶ + ae22j + α39Κ, 


Cn = Qinl + A2nJ + a3nk. 


Use the fact that none of the e; are zero to successively eliminate i, j, and k from 
these equations, and conclude that » < 3. Now reverse the argument to show 
that 3 < n.] 
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1-6 COORDINATE SYSTEMS 


Definition 1-7. Let e,,...,e, be a basis for U and let 
x = aye, + sos + ape, 


be the unique expression for x in terms of this basis (Theorem 1-3). Then 
the scalars a1,..., a, are called the coordinates or components of x with 
respect to €;,...,€,, and the basis vectors themselves are said to form 
a coordinate system for U. Finally, the subspaces of © spanned by each 
of the e; are called the coordinate axes of the given coordinate system. 


Thus a basis is a coordinate system, and the unique expression for a vector as a 
linear combination of basis vectors is nothing other than the “decomposition” 
of the vector into its components along the various coordinate axes. In these 
terms the direct statement in Theorem 1-3 assumes the following eminently 
reasonable form: The coordinates of a vector are uniquely determined by the coordi- 
nate system. 

At the same time, we caution the student not to expect too much from a co- 
ordinate system, and especially not to fall into the error of expecting coordinate 
axes to be mutually perpendicular. Strictly speaking, of course, the concept of 
perpendicularity in a vector space has no meaning yet, but it will be defined in 
Chapter 7. Nevertheless, it is common knowledge that certain coordinate axes, 
such as the standard ones in ®”, are mutually perpendicular. We merely wish 
to emphasize the sometime nature of this phenomenon, and call attention to the 
existence of ‘“‘oblique’’ coordinate systems. One such is the coordinate system 
ej,.-..,€, for ®” introduced in Example 2 of the preceding section. 

In this connection, it is also worth mentioning explicitly that the coordinates 
of a vector change with a change of coordinate system. Failure to appreciate the 
implications of this innocent and obvious statement often causes confusion, or 
worse, for the unwary. For example, the vector x = (4, 2) has coordinates 4, 2 
with respect to the standard coordinate systeme, = (1,0),e2 = (0, 1) in ®?, since 


(4,2) = 46, + 26.. 


However, if we use the coordinate system e; = (1,0), es = (1, 1), then the 


e2 = (0,1) th) 


ει = (1,0) ει = (1,0) 


FIGURE 1-10 
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coordinates of x become 2, 2, since 
x= 4e/+2e’, 
(4,2) =2e6 + 2e600 2 fmm TTT TES , 
Indeed, the vector in ®? having coordi- 
nates 4, 2 with respect to e;, es is the or- 
dered pair (6,2). (See Figs. 1-10 and 
1-11.) 

Finally, we call attention to the fact FIGURE 1-11 
that the operations of vector addition and 
scalar multiplication are converted into ordinary addition and multiplication when 
they are carried out with respect to a basis. For then these operations are per- 
formed componentwise, irrespective of the nature of the vectors involved (n-tuples 
of real numbers, polynomials, etc.). We prove this assertion as follows: 


Theorem 1-4. Let e,,...,€, be any basis for a vector space ©. Then 
the sum of two vectors in Ὃ is found by adding their corresponding components, 
and the product of a vector and a scalar a is found by multiplying each com- 
ponent of the vector by a. 


Proof. If x = aye; + τ΄ + ane, and y = Bye, + °°: + Bren, then it follows 
directly from the axioms defining a vector space that 


x+y = (a; + Bilei +°°* + (Qn + Brden, 
and that 
aX = (aa ey + °° + (aan)en, 
as asserted. Jj 


Among its various implications, this theorem foreshadows the use of bases in 
finite dimensional vector spaces whenever extensive numerical calculations are 
in the offing. On the other hand, as long as we are concerned with the general 
theory of vector spaces, bases are a distinct hindrance. This stems from the fact 
that whenever a basis is used in the proof of a theorem which purports to be a 
general statement about finite dimensional vector spaces, one must then prove 
that the result in question is independent of the particular basis chosen to prove it. 
And this is usually as difficult as it is to construct a coordinate free proof of the 
original statement. 


EXERCISES 


1. Find the coordinates of each of the following vectors in R? with respect to the basis 
(1, 0,0), G, 1,0), (1,1, 1). 
(a) (0, 1, 0) (c) (0, 0, 1) (e) (4, —2, 2) 
(b) (-- 2,1, 1) (ὦ (—1, 3, 1) (Ὁ (, 3, 2) 

2. Repeat Exercise 1 using the basis (1, 1, 0), (1, 0, 1), (0, 1, 1). 
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3. Prove that the vectors (2, 1,0), (2, 1,1), (2,2, 1) form a basis for 6.38. Find the 
vectors in R? which have the following coordinates with respect to this basis. 
(a) 1, 0,0 (c) 4, —5, 0 (e) 3,1, -- 
(b) —1, 2,1 (ὦ 4, 2, 1 (f) 2, 2,1 

4. Find the coordinates of the standard basis vectors in ®? with respect to the basis 
given in Exercise 3. 

5. Find a basis in ®* with respect to which the vector (—3, 1, 2, —1) has coordinates 
tot), 4; 

6. Let 61, e2, 63 and ej, οὖ, e3 be bases for a vector space U, and suppose that 


/ ᾽ὔ / 
61 = aye) + aze2 + a3e3, 
Bie, + βορὰ + Be, 


e3 = γε + Yeeo + 73e5. 


€2 


Find the coordinates of the vector x = x 1e; + x2e2 + x3e3 with respect to the 
basis οί, e€, e3. 

7. Does there exist a basis for 612 with respect to which an arbitrary vector (x1, x2) has 
coordinates 2x; and 3x2? 

8. Find a basis for 612 with respect to which an arbitrary vector (x1, x2) has coordinates 
x, and x1 + 2χ2. 

9. Let e1,...,@n and ej,...,e% be bases for a finite dimensional vector space VU, 
and let 


/ 
Θ᾽ = aie, + a2ie2 +:°°° + anien, 
/ 
€2 = a12e1 + ag2eg2 + °°* + An2en, 
en = A1in@l + A2Qne2 + δι + Annen.- 
Find the coordinates of x with respect to e1,...,€, given that 
x = xe, + χορὸ + τ΄’ + xhen. 


1-7 DIMENSION 


Theorem 1-5. Jf 0 has a basis containing n vectors, then any n + 1 or 
more vectors in Ὃ are linearly dependent.* 


The technique used to prove this theorem has already been introduced in Exer- 
cise 27 of Section 1-5 to treat a particular case. The reader may find it helpful to 
keep that exercise in mind while reading the following proof. 


* The statement of Theorem 1--5 also applies to the trivial space consisting of just the 
zero vector, provided we agree that the empty set of vectors is a basis for this space. Such 
an agreement is consistent with our definition of a basis for a vector space, and with the 
convention that the dimension of the trivial space is zero. 
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Proof. Let e1,...,€, be ἃ basis for U, and suppose, contrary to the assertion of 
the theorem, that Ὃ contains a linearly independent set ej,...,¢@m in which 
m > n. Express each of the 67 as a linear combination of the 6;, thereby obtaining 
the system of equations 


e = ay1@y + agg + τ᾿’ + Gnil€n, 

C5 = ayo@, + ago€e - τ΄ + An2en, 

: (1-30) 
Cin = αι + Aeaml2 + a + Anmlns 


in which the a;; are scalars. Since none of the 67 is the zero vector, at least one 
of the a;; is different from zero in each of these equations. (Recall that the zero 
vector is linearly dependent on every vector in 0.) Thus, by relabeling the 6; if 
necessary, we may assume that α11 τέ 0. This done, solve the first equation for 
e;, and substitute the value obtained in the remaining m — 1 equations. This 
eliminates e, from (1-30), and yields a system of equations of the form 


C5 = Boo€e + B320e3 + τ + Bnoen + 81204, 
8. = Boz3€o + B33e3 - τ’ + Bnsen + 81301, 


. Ὁ 
ω 
| 


(1-31) 


[4 
3 ~ 
| 


= Bome2 + Bames + °*+ + Bnmen + Bim’. 


Focusing our attention on the first of these equations we note that the linear 
independence of οἱ and es implies that at least one of the coefficients Boao, 
B32,---,Bn2is different from zero. Assume that the 6; are labeled so that By. ¥ 0. 
Then a repetition of the above argument, now applied to 6.0, reduces (1-31) to 
the system 


e3 = Y33e3 τ Ynzen + Ὑ1561 + Yo3e9, 


Cy: = Y3me3 + ae + Ynmen + Vime4 + Yomed. 


Let us now speculate on the effect of our assumption that m is greater than n. 
A moment’s thought will reveal that by continuing the above process of elimina- 
tion we will eventually find ourselves confronted with a system of m — n equations 
expressing each of the vectors ey, 41, ..., @m aS a linear combination of ej, ..., en. 
But this cannot be. Hence m < n after all. J 


Corollary 1. Jf Ὃ has a basis containing n vectors, then every basis for Ὃ 
contains n vectors. 


Proof. If e;,...,€, and ej,...,@m are bases for Ὁ, then the above theorem 
implies that m < n, andn < μι. Hencem = n.J§ } 
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This result furnishes the necessary justification for the definition of the dimension 
of a vector space given in Section 1-5. 

Theorem 1-5 also allows us to prove the reassuring fact that every subspace of a 
finite dimensional vector space is finite dimensional, and that its dimension does 
not exceed the dimension of the whole space. This is the content of 


Theorem 1-6. Jf Ὁ is a subspace of an n-dimensional vector space 0, 
then dim W <n. 


Proof. The theorem is obviously true if n = 0, or if W is the trivial subspace of 
U.* Thus we can assume n > 0, and W nontrivial. 

By virtue of this last assumption, ‘W contains linearly independent sets of vectors, 
since any nonzero vector in W is, by itself, such a set. Moreover, every linearly 
independent set in W is also linearly independent as a set in U. Thus, by Theorem 


1—5, the number of vectors in such a set cannot exceed n. Finally, if e,,...,em 
is a linearly independent set in ‘W containing a maximum number of vectors, then 
S(€1,...,@m) = W. Hence dimW = m < ἢ, as advertised. J 


This theorem may be read as asserting that every nontrivial subspace ‘W of an 
n-dimensional space Ὃ has a basis e),...,€, with m <n. If μι =n, then 
€1,...,€m 15 also a basis for U, and W = Ὁ. On the other hand, if m « ἢ, 
then ‘W is a proper subspace of Ὃ (1.e., W σέ WV), and there exist vectors in U 
which do not belong to W. Choose any such vector, and label it e,,, 1. Then it 
is all but obvious that e1,...,@m4 1 are linearly independent in Ὁ. 

To prove the truth of this observation, we apply the test for linear independence 
(p. 20) as follows. Suppose that 


aye, +--+ + Amlm + Am4+1€m41 = 0. (1-32) 


Then am41 = 0, for otherwise 


Qi Am 


Cn+1 = — Cy = Pe Cms 
Am+1 Am+1 
and €m4 118 in ‘W. Thus 
aye; + +++ + Amen = 0, 
and it follows from the linear independence of e;,...,@, thata,; =-+-: = am = 0. 
Hence all of the coefficients in (1-32) are zero, and e;,...,€m4 1 are linearly 
independent. 
We now repeat the above argument, this time starting with the subspace 
8(€1,...,@m4i). If 8(e1,...,@m41) 15 a proper subspace of U we can enlarge 
€1,...,€m41 to a linearly independent set in U containing m + 2 vectors. But 


* Recall that the dimension of the trivial space is zero. 
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Theorem 1-5 implies that this process must come to a halt after n — mi steps, 
at which point we will have a basis for ©. With this we have proved the following 
important and useful result. 


Theorem 1-7. Let Ὃ be an n-dimensional vector space, and let e;,...,€m 
be a basis for an m-dimensional subspace of ©. Then there exist n — m 
VECLOrS CEm4i1,---5€n in Ὃ such that e1,...,€m,em+1,---; θη is a basis for 
Ὅ. 


EXERCISES 


1. 


What is the dimension of the subspace of 615 spanned by 
(a) the vectors (2, 1, —1), (3, 2, 1), (1, 0, —3)? 
(Ὁ) the vectors (1, —1, 2), (0, 2, 1), (—1, 0, 1)? 


. What is the dimension of the subspace of ®* spanned by 


(a) the vectors (1, 0, 2, —1), 3, —1, —2, 0), (4, —1, —6, 2), (0,1, 8, —3)? 
(Ὁ) the vectors (— 4, 4, 3, —1), (, 0, 1, —4), dl, 1, 10, —4)? 


. Let W be the set of all polynomials in &, whose second derivative is zero; i.e., 


p(x) belongs to W if and only if (d?/dx?)p(x) = 0. 
(a) Prove that ἊΝ is a subspace of @,, and find a basis for W. 
(Ὁ) Extend the basis for W found in (a) to a basis for Φ,. 


. Let W be the set of all polynomials p(x) in @, such that p(1) = p’(1) = 0. 


(a) Prove that ἊΝ is a subspace of @,, and find a basis for W. 
(Ὁ) Extend the basis for W found in (a) to a basis for Φ,. 


. (a) Find the dimension of the subspace of C[—z, 2] spanned by the vectors 1, 


sin x, sin? x, cos? x. | 
(b) Repeat part (a) for the vectors sin x cos x, sin 2x, cos 2x, sin? x, cos? x. 


6. Prove that the vector space C[a, δ] is infinite dimensional. 


10. 


. What is the dimension of the subspace of all solutions (in 6.3) of the single linear 


equation 
Q1X1 + aex2 + az3x3 = 0? 


. What is the dimension of the subspace of all solutions (in 615) of the single linear 


equation 
a1X1 + aoxe + °°* + GnxX, = 0? 


. Given the vectors x; = (2,0, 1, 1) and x2 = (1, 1, 0, 3) in @4, find vectors x3 and 


x4 such that x1, Χο, x3, x4 form a basis for ®?. 
Let Ὃ be a vector space of dimension n. Prove that U contains a sequence of sub- 
spaces | 
0s. Wis caus Va 
having the following two properties: 
(a) dim U; = i Μ 
(Ὁ) U, is a subspace of U; whenever i < "). 
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11. Let U1 and U2 be finite dimensional subspaces of a vector space U, and suppose 
that ©, and U2 have only the zero vector in common. Let e1,...,e€, be a basis 
for U1, and ej,...,e, a basis for Ue. Prove that e1,...,€m, €1,.--,€, 15 a basis 
for the subspace W = VU, + ὃ. of VU (cf. Exercise 22, Section 1-4). Deduce that 
dim W = dimV, + dim Ve. 

*12. Let U1 and Vz be finite dimensional subspaces of a vector space U. Prove that 
U1 + Ue is finite dimensional, and that 


dim (Ὁ; + U2) = dim, + dim V2 — dim (U1 N V2). 


13. Let U1 be an m-dimensional subspace of an n-dimensional vector space U0. Prove 
that there exists an (7 — m)-dimensional subspace U2 of U such that 
(a) Ui + V2 = Ὁ, and 
(Ὁ) Ui M Ve contains only the zero vector. [Hint: Choose a basis for U1 and 
extend this to a basis for U.] 


1-8 GEOMETRIC VECTORS 


Informally, geometric vectors are arrows in the plane or 3-space. As such, they 
are familiar to anyone who has studied elementary physics, where they appear 
as forces, velocities, accelerations, etc., i.e., quantities having a magnitude and 
direction. In this section we propose to examine some of the vague ideas associated 
with the use of such arrows, and make these ideas precise by constructing the 
space of two-dimensional geometric vectors. Besides furnishing us with still an- 
other example of a real vector space, this discussion will provide the link between 
our definition of the term vector and the vectors introduced in elementary calculus 
and physics.* 

The geometric notion of an arrow in the plane finds its mathematical analogue 
in the concept of a directed line segment. Specifically, the line segment between 
two distinct points A and B in 612 is said to be directed if the points are given a 
definite order, say A, B. In this case we speak of the directed line segment from 
A to B, which we denote by AB. A is then called the initial point of the segment, 
and B the terminal point. We also agree to regard a single point as a directed line 
segment, in which case the relevant symbol is 44. 

Intuitively the directed line segment AB has a magnitude and direction. At 
first sight one might be tempted to define these concepts as length and angular 
measure with respect to a coordinate system in the plane. However, any such 
definition would have the grave defect of making the magnitude and direction of 
AB dependent upon the coordinate system used, in conflict with the intuitive de- 
mand that they be intrinsically associated with AB itself. Unfortunately there is 


* With obvious minor changes the following discussion can be adapted to 3-space or, 
for that matter, to n-space. 
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no way out of this dilemma so long as we continue to focus our attention upon a 
single segment. But when we turn to the set of all directed line segments in ®?, 
we observe that it is as easy to determine when two segments have the same mag- 
nitude and direction as it is difficult to say what these terms mean. Indeed, using 
the notion of parallel translation, we can say that AB and CD have the same mag- 
nitude and direction if and only if they can be brought into coincidence by such a 
translation. Furthermore, the entire theory of geometric vectors can be based 
upon this simple observation. 
We begin by giving the above discussion formal status in 


Definition 1-8. Let AB and CD be directed line segments in the plane, 
and suppose CD is translated parallel to itself until its initial point coincides 
with A. Then, if the terminal points of the two segments also coincide, 
we say that AB and CD have the same magnitude and direction, and we 
write AB ~ CD (read “AB is equivalent to CD”). 


For future use we note the following simple consequences of this definition: 


AB ~ AB, (1-33) 
AB ~ CD implies CD ~ AB, (1-34) 

and 
AB~ CD and CD~ EF imply AB ~ EF. (1-35) 


And now we give the basic definition. 


Definition 1-9. The collection of all] directed line segments in the plane 
which have the same magnitude and direction as a given segment AB 1S, 
by definition, the two-dimensional geometric vector v(AB) determined by 
AB. Any directed line segment in this collection will be called a representa- 


tive of v(AB), and the set 92 consisting of all such vectors is called the 
space of two-dimensional geometric vectors. 


At first sight this definition may seem somewhat bizarre, but it does in fact yield 
precisely the sort of quantity we want in a geometric vector. For, whatever other 
ideas one may have concerning geometric vectors, it is clear that every such vector 
must be completely determined by its magnitude and direction. In other words, 
it consists of nothing but a magnitude and direction. And when we consider equiva- 
lent directed line segments AB and CD as entities having only a magnitude and 
direction, forgetting about their initial and terminal points, it is also clear that 
AB and CD are then effectively identical. Thus equivalent directed line segments 
are not distinct geometric vectors; they are distinct representatives of the same 
geometric vector. This, of course, is the content of Definition 1-9. Figuratively 
speaking, 92 is the totality of directed line segments in the plane viewed so my- 
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Opically that segments having the same magnitude and direction are indis- 
tinguishable. 

But can we accept Definition 1-9 as it stands? Hardly; for we still lack the 
necessary assurance that a geometric vector is unambiguously determined by any 
one of its representatives. Phrased somewhat differently, the validity of Defi- 
nition 1-9 depends upon the fact that no directed line segment can be a repre- 
sentative of more than one geometric vector. Intuitively this is clear, but the student 
should nevertheless appreciate the need for a proof based upon the definitions. 
This is accomplished by the following theorem, which actually establishes a 
somewhat stronger result. 


Theorem 1-8. Every directed line segment in the plane is a representative 
of one and only one two-dimensional geometric vector. 


Proof. If AB is a directed line segment in 6", then by Definition 1-8, v(AB) 1S 
a geometric vector having AB asa representative. Hence every directed line seg- 
ment is a representative of at least one geometric vector, and it remains to prove 
that 4B cannot represent more than one. 

Thus suppose AB also represents the vector v(CD). Then, if EF is any repre- 
sentative of v(CD), EF ~ CD. But AB ~ CD, and hence by (1-34) we have 
CD ~ AB, and by (1-35) EF ~ AB. This shows that every representative of 
v(CD) is also a representative of v(AB). Now reverse the argument to conclude 
that every representative of v(AB) is also a representative of v(CD). Hence 
v(AB) = v(CD), as required. ἢ 

C 


A B FIGURE 1-12 


To define vector addition in 97 we make use of the simple and geometrically 
obvious fact that if v is an arbitrary geometric vector, and P 15 any point in the 
plane, then there exists precisely one representative of v with initial point P. 
(To produce this representative, select any segment belonging to v and translate 
its initial point to P.) This having been said, let v and w be vectors in 95, and 
choose a representative AB of vy. Then, if BC is that representative of w y with 
initial point B, we define v + w to be the vector v(AC). Geometrically, AC is 
the third side of the triangle formed from AB and BC, as shown in Fig. 1-12. 

Here again we have a definition which requires justification, for it is predicated 
upon the fact that v + w remains the same regardless of which representatives of v 
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FIGURE 1-13 


FIGURE 1-14 FIGURE 1-15 


and w are used to compute it. But this, we assert, is obvious. For if A’B’ ~ AB, 
and B’C’ ~ BC, then triangles A’B’C’ and ABC will be congruent, and a parallel 
translation will bring A'C’ into coincidence with AC (see Fig. 1-13). 

With this difficulty out of the way, we invoke elementary geometry to prove 
that v + (w+ x) = (v+ w)+ x, and that v + w = w+ v (appropriate 
diagrams appear above in Figs. 1-14 and 1-15). Moreover, if we set 0 = v(AA), 
then v + 0 = v for every v in §?; while if v = v(AB), it is clear that the vector 
—v = v(BA) has the property that v + (—v) = 0. Thus the additive axioms 
for a vector space are satisfied in 92. 

Next let v(AB) be an arbitrary nonzero vector in 9“, and let a be a real number. 
Choose a unit of distance on the ray from A through B, and let [48] denote the 
length of the segment AB. Then there exists a unique point C on this ray such 
that |AC|/|AB| = [α], where |a| denotes the absolute value of a. If a > 0, let 
av = w(AC); while if a < 0, let αν = —v(AC) = v(CA). Finally, when v = 0, 
set av = 0 for all a. (We can describe av as the collection of line segments in the 
plane whose magnitude is |a|-times the magnitude of AB, and whose direction is 
the same as or opposite to that of AB according as a is positive or negative.) 
With this we have defined a scalar multiplication in 92, and geometric arguments 
can again be used to prove that the required axioms are satisfied. Thus 92 is a 
real vector space. 
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It is both interesting and instructive to compare this space with the vector space 
GR defined in Section 1-1. To effect this comparison consider the totality of 
directed line segments in the plane which have their initial point at the coordinate 
origin in 612. On the one hand, this collection of vectors is none other than the 
set of vectors which comprise 612. However (and this is the crux of our argument), 
it may also be viewed as a complete set of representatives of the vectors in 95. 
(Recall that every vector in 92 has precisely one such representative, and con- 
versely, every such directed line segment represents a unique vector in 93.) In 
other words, the vectors in ®” are simply a particular set of representatives of the 
vectors in 92. From this it follows that if we agree to replace each vector in 95 
by its unique representative emanating from the coordinate origin in ®?, we find 
that 4.2 and S? then consist of precisely the same vectors. Moreover, addition and 
scalar multiplication in 92 then become identical with the corresponding opera- 
tions in 612. Thus we conclude that ®? and the space of two-dimensional geometric 
vectors are essentially identical. ¢? is simply ®? stripped of its coordinate system, 
and conversely, ®? is 92 seen by means of a coordinate system. 


EXERCISES 


In Exercises 1 through 5 find two other directed line segments which have the same 
magnitude and direction as AB for the given values of A and B. 

1. A = (1,1), B = G, 1) 2. A = (-—2,1), B = (0,0) 

3. A= (4, -1), B = G,)) 4. A = (-—4,—-}), B= (-4.2 

5. A = (0,2), B = (-3, -—)) 

In Exercises 6 through 10 find v(AB) + v(CD) for the given values of A, B, C, Ὁ. 

6. A = (0,0), B = (1,2), C = (1,2), δ = G,9) 

7. A = (0, —1), B = (—2,1), C = G,0), ὃ = 6, —2) 
8. A = (—1,1), B = (2,1), C = (,3), δ = (—1, 2) 

9. A = (4,3), B = G, -—®), C = (—2,4), δ = ©, —%) 
10. A = (—2, —5), B = (—1, —2), C = 0,4), ὃ = (6,7) 

In Exercises 11 through 15 find the vector in R? which represents the geometric vector 

v(AB) for the given values of A and B. 

11. A = (—1,1), B = @,1) 12. A = (-—2,1), B= 
13. A = (0,2), B = (—3, -- 2 14. A = @,4), B = (-3, 2) 
15. A = (6, —3), B = (-7, --9) 

In Exercises 16 through 20 find the value of av (AB) for the given values of A, B, and a. 
16. A = (—5,7), B = (5,10), a = 4 17. A = (9,2), B = (5, —2),a = -ξ 
18. A 3,6), B = (4,8), a = 3 19. 4 = (0,5), B = (11,0), a = —1 
20. A = (—3, --1), B = (—4, —5), a = 3 
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21. Let A = (x1, y1)and B = (xo, y2) be any two points in R2, and suppose AB ~ CD, 
where C = (x3, y3). Find the coordinates of the point D. 

22. Let A = (x1, y1) and B = (xo, yz) be any two points in 612, and let a be a real 
number. Find a representative of the geometric vector av(AB). 

23. Given A = (x1, 1), B = (x2, y2), C = (x3, y3), D = (x4, ys), four points in R?. 
Compute v(AB) Ἔ v(CD). 

24. Prove that v(AB) + v(CD) = v(CD) Ἔ v(AB) for any pair of geometric vectors. 
[Hint: Use the result of Exercise 23.] 

25. Prove that the addition of geometric vectors is associative. [Hint: Use the result 
of Exercise 23.] | 

26. Using the results of Exercises 22 and 23 prove that a(v + w) = av + aw and 
(a + B)v = av + βν for any pair of geometric vectors v, w, and any pair of real 
numbers a, £. 

27. Use the result of Exercise 22 to prove that (@8)v = a(Gv) for any geometric vector v, 
and any pair of real numbers a, 8. 


*1-9 EQUIVALENCE RELATIONS 


We have seen that a geometric vector is a collection of directed line segments 
mutually related by magnitude and direction. This is but one example of the 
method whereby a new mathematical entity is defined as a collection of related 
objects of some familiar type. We shall have occasion to use this technique again, 
and it may therefore be of some interest to present it in its general setting. As 
usual we begin with a definition. 


Definition 1-10. An equivalence relation ® on a set ὃ is a set of ordered 
pairs (x, y) of elements of 8, subject to the following conditions: 


(i) The pair (x, x) belongs to ® for every x in 8; 
(ii) If (x, y) belongs to ®, then so does (y, x); 
(iii) If (x, y) and (y, z) belong to &, then (x, z) belongs to &. 


Whenever an ordered pair (x, y) belongs to an equivalence relation on 8, one says 
that x is equivalent to y, and writes x ~ y. Custom then dictates that the’symbol “Ὁ 
(usually called “tilda” or simply ‘“‘wiggle’’) rather than Οἱ itself be referred to as the 
equivalence relation on 8. In these terms the defining conditions of an equivalence 
relation on 8 become 


(i) x ~ x for all x in 8, 
(ii) x ~ y implies y ~ x, 
(11) x ~ yand y ~ zimply x ~ z. 


One also says that an equivalence relation is reflexive, symmetric, and transitive; 
these names being given respectively to properties (1), (ii), and (111) above. 
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Equivalence relations crop up in every branch of mathematics, and usually in a 
very fundamental way, as the following examples illustrate. 


EXAMPLE 1. The relation of equality applied to the elements of any set ὃ is 
obviously an equivalence relation on 8. In fact, the notion of an equivalence 
relation can be viewed as a generalized form of equality. 


EXAMPLE 2. Let 8 be the set of all triangles in the plane, and let A, ~ A. mean 
that A, and A» are congruent. Then ~ is an equivalence relation on 8. 


EXAMPLE 3. Let 8 be the set of directed line segments in the plane, and let 
AB ~ CD have the meaning assigned in Definition 1-8. Then (1-33) through 
(1-35) imply that ~ is an equivalence relation on 8. 


EXAMPLE 4. Let 8 be the set of real valued functions which are continuous at 
all but a finite number of points in an interval [a, b]. If fand g are two such func- 
tions, let f ~ g mean that f(x) = g(x) for all but a finite number of values of x 
in [a, Ὁ]. Then ~ is an equivalence relation on ὃ (see Exercise 1). 


EXAMPLE 5. Let 8 be the set of all “symbols” of the form a/b, where a and ὁ 
are integers, and ὁ ~ 0. Set (a/b) ~ (c/d) if and only if ad = bc. Then ~ is an 
equivalence relation on 8 (see Exercise 2). (Just as arrows in the plane represent 
geometric vectors, the symbols a/b in ὃ represent rational numbers, and the 
equivalence relation introduced here allows us to define a rational number as a 
collection of mutually equivalent symbols of the form a/b. This example is 
discussed in greater detail in Exercise 6.) 


If ~ is an equivalence relation on a set 8, and x is any element in ὃ, then the set 
of all elements y in 8 such that y ~ x is called the equivalence class determined by x. 
This equivalence class is denoted by [x], and any element belonging to it is said 
to be a representative of [x]. In particular, x itself is a representative of the equiva- 
lence class [x], since x ~ x. : 

We now come to the fundamental theorem concerning equivalence relations, 
a special case of which was proved in the last section. 


Theorem 1-9. Jf ~ is an equivalence relation on a set 8, then every element 
of 8 belongs to one and only one equivalence class of elements of 8. 


For a proof, see Theorem 1-8. 

It is this result which justifies using equivalence relations to define new mathe- 
matical objects. The objects in question are the equivalence classes, and the above 
theorem asserts that every such object is uniquely determined by any one of its 
representatives. This type of definition is sometimes called “definition by abstrac- 
tion,” since it passes from the particular to the general by regarding mutually 
equivalent individuals as identical. 
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EXERCISES 


1. Prove that the relation defined in Example 4 above is an equivalence relation. 


2. Prove that the relation defined in Example 5 above is an equivalence relation. What 
is the equivalence class determined by $? By +? By 2? 

3. Let ὃ be the set of all integers, and let m be a fixed positive integer. If x and y belong 
to ὃ, set x ~ yif and only if x — yis divisible by γι. Prove that ~ is an equivalence 
relation on 8, and find αἰ the equivalence classes for this relation when m = 2, 3, 
and 4. 


4. A partition of a set ὃ is defined to be a collection Φ of subsets of 8, each of which 
contains at least one element of ὃ, and such that every element of 8 belongs to one 
and only one of the subsets making up Φ. (Informally, a partition chops ὃ into pieces, 
and these pieces are the subsets belonging to @.) In these terms, the fundamental 
theorem on equivalence relations can be restated as follows: If ~ is an equivalence 
relation on a Set ὃ, then the equivalence classes determined by ~ yield a partition of 8. 
Prove the following converse of this theorem: Jf Φ is a partition of a set 8, then 
there exists an equivalence relation on ὃ whose equivalence classes coincide with the 
subsets of the given partition @. (Note that these two results imply that the concepts 
of an equivalence relation on a set and a partition of a set are identical.) 

*5. Let f be a function with domain Ὁ and range ® (i.e., f associates with each x in Ὁ 
a unique element y in ® denoted f(x) and called the image of x under f, and each y 
in ® is the image of at least one x in D). 

(a) If x; and x2 belong to D, set x1 ~ x2 if and only if f(x1) = f(x2). Prove 
that ~ is an equivalence relation on D. 

(Ὁ) Let Φ be the partition of © defined by this equivalence relation (see Exercise 4). 
Prove that there exists a one-to-one function g with domain Φ and range ® such 
that g([x]) = f(x) for each x in ©. (Recall that a function f is one-to-one if 
f(x1) = f(*2) implies x1 = x2.) 

*6. The rational numbers. Let S be the set of all symbols a/b, ὁ ~ 0, introduced in 
Example 5 above, and let ~ be the equivalence relation that was defined on §; i.e., 
a/b ~ c/d if and only if ad = bce. Let Q be the set of all equivalence classes of the 
elements of ὃ under this equivalence relation. Then the equivalence classes belonging 
to Q are, by definition, rational numbers, and the set Q itself is called the set of all 
rational numbers. Thus the rational number [a/b] is the equivalence class containing 
the symbol a/b. 


(a) To define addition of rational numbers set 


a ς ad + be 
2 + [S| - [| 
Prove that if a’/b’ ~ a/b and c’/d' ~ c/d, then 
‘a'd' + b'c! = ad +: be 
δ΄ α΄’ ῥά 
and thus conclude that the above equation actually defines an addition of equivalence 
classes. 
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(b) To define multiplication of rational numbers set 


a Ἵ - “| | 
b\|d}  |bd 
Prove that if a’/b’ ~ a/b and c’/d’ ~ c/d, then 
α IRs 
b’d’ = bd 
and thus conclude that the above equation actually defines a multiplication of equiva- 
lence classes. 


2 


linear transformations 


and matrices 


2-1 LINEAR TRANSFORMATIONS 


Up to this point our study of real vector spaces can best be described as a modest 
generalization of some of the ideas implicit in analytic geometry. Although such 
terms as linear dependence and independence, subspaces, bases, and the like, may 
have been unfamiliar they actually add little to the knowledge of vector spaces 
taught in elementary geometry. All this changes, however, as soon as these ideas 
are used to study functions defined on vector spaces. Here new and important 
things do happen, and as the following discussion unfolds we shall find the con- 
cepts introduced earlier taking on added meaning and significance. 

The simplest yet most important functions which arise in the study of vector 
spaces are known as linear transformations, and are defined as follows: 


Definition 2-1. A Jinear transformation, ot linear operator, from a vector 
space U, to a vector space U2 is a function A which associates with each 
vector x in Ὃ;: a unique vector A(x) in Ue in such a way that 


A(x, + X2) = A(xi1) + A(K2) (2-1) 
and 
A(ax) = aA(x) (2-2) 


for all vectors x}, Χο, X in UV, and all scalars a. 


In other words, a linear transformation is a function, or mapping, from one vector 

space to another which sends sums into sums and scalar products into scalar 

products (see Fig. 2-1). These requirements are sometimes referred to by saying 

that a linear transformation is “compatible” with the algebraic operations of addi- 

tion and scalar multiplication defined on vector spaces, and it is just this com- 

patibility which accounts for the importance of such functions in linear algebra. 
41 
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Vy Vo 


A(X} +X2)= 
A(X;)+A (Xo) 


FIGURE 2-1 


One consequence of Definition 2-1 is that a linear transformation always maps 
the zero vector of VU, onto the zero vector of Ug; that is, 


A(O) = 0. (2-3) 

Another is that 
Α(αιχι + °° + anXn) = a@1A(K1) + °° °° + an A(Kn) (2-4) 
for any finite collection of vectors x1,...,Xn in U, and scalars ay,..., ap. 


The first of these assertions can be established by setting a = 0 in (2-2), the second 
by repeated use of (2-1) and (2-2) in the obvious fashion. In particular, when 
n = 2, (2-4) becomes 


A(a 1X1 + α2Χ9) = a1A(K1) + agA(X2). (2-5) 


We call attention to this equation in order to remark that, by itself, it can be (and 

often is) taken as the definition of a linear transformation, since (2-1) and (2-2) 

are satisfied if and only if (2-5) is. (See Exercise 17.) From time to time we shall 

use this fact when proving that a function is a linear transformation. : 
If A is a linear transformation from 0; to Us, we write A: U; — Ve (read 

“4 maps U, into U,”’), and refer to Ὃ; as 

the domain of A. In this case the set of all U; 

vectors y in U2 such that y = A(x) for some 

x in U, is called the image or range of A, 

and is denoted by 9(A). Lest it be over- 

looked, we point out that the image of A 

need not be all of Uo, a possibility which is 

made explicit by saying that A maps U, 

into U2 (Fig. 2-2). Of course, it may hap- 

pen that 9(A) = Ve, in which case the 

term onto is used. And finally, it should be 

_ Observed that there is nothing in the above 

definition to prevent U, and Uz from being FIGURE 2-2 
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Χο Χο 


A(€2)= (1,1) 


nee ἀῶ = (x), —X3) 


FIGURE 2-3 FIGURE 2-4 
one and the same vector space. Indeed, this is one of the most fruitful settings in 
which to pursue the study of linear transformations. 

We conclude this section by giving a number of examples, several of which will 
figure prominently in our later work. For the most part we simply state the 
definition of the function in question, and omit the routine verification of linearity 
in the expectation that the reader will supply the missing argument for himself. 


EXAMPLE 1. Let x = (x1, ΧΩ) be an arbitrary vector in ®”, and set 


A(x) = (X1, —X2). 


Geometrically A can be described as the linear transformation mapping ®* onto 
itself by reflection across the x-axis. (See Fig. 2-3 where, for generality, the 
effect of A has been depicted relative to an oblique coordinate system.) 


EXAMPLE 2. Let A be the mapping of 612 onto itself obtained by shearing the 
plane horizontally so that the x-axis is shifted through a 45° angle as shown in 
Fig. 2-4. Analytically, A is defined by the equation 


A(x 1, Xo) = (X1 + Χῳ, X2), 
and is clearly linear. 


EXAMPLE 3. Let £ be any line through the origin in δι᾽, and let A be a fixed 
rotation about ἢ. Then, arguing geometrically, it is easy to show that A is a linear 
transformation mapping δι onto itself. 


EXAMPLE 4. The mapping which sends each vector in U, onto the zero vector 
in Ug is clearly a linear transformation from U, to Ue for all Ὃ; and Vo. It is 
called the zero transformation, and is denoted by the symbol O, irrespective of the 
vector spaces involved. 


EXAMPLE 5. A second linear transformation for which we reserve a special 
symbol is the identity transformation I mapping a vector space VU onto itself. 
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The defining equation for J 1s 
I(x) = x 


for all x in VU; its linearity is obvious. 


EXAMPLE 6. Consider the space C€[a, δ] of all real valued continuous functions 
on the interval [a, δ], and for each f in C[a, δ] set 


A(f) = [τὸ at a<x<b. 


Then since A(f) is continuous on [a, b], A can be viewed as a mapping of C[a, δ] 
into itself. As such it is linear since 


Aart + asfs) = [ “feafi(t) + asfo(t)] dt 


5: [ ef (t) dt + [ “αὐοἴο() dt 


δὴ [ f,(t) dt + as [ f(t) dt 


= a,A(fi) + a2A(fe). 


EXAMPLE 7. For the same reasons as those just given, the mapping A: C[a,b] — @! 
defined by 


Ag) = f "ΤΟ dx 


is also linear. 

EXAMPLE 8. Let @'[a,b] denote the space of all continuously differentiable 
functions on [a, Ὁ] (see Example 3 in Section 1-4), and let D denote the operation 
of differentiation on this space; that is, D(f) = f’. Then the familiar identities 


D(f, + fe) = Df) + Dif), Daf) = aD(f) 


imply that D is a linear transformation from @'[a, δ] to C[a, b]. More generally, 
the operation of taking nth derivatives is a linear transformation mapping the 
space of n-times continuously differentiable functions on an interval [a, δ] into 
the space C[a, δ]. 


EXERCISES 


Prove that each of the following equations defines a linear transformation from ®? into 
(or onto) itself, and describe the effect of the transformation in geometric terms. 

1. Α(χι, x2) = --(χι, x2) 2. A(x1, X2) = (2x1, x2) 

3. A(x1, x2) = 2(%1, X2/3) 4, A(x1, x2) = 3(x1, x2) 

5. A(xi, x2) = ναι — χο,χι + x2) 6. A(xi, x2) = (xe, x1) 
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7. A(x1, x2) = —(x2, x1) 8. A(x1, x2) = (11 + X2, x1 + ΧΩ) 

9, A(x1, X2) = (0, 0) 10. A(x, X2) = (χι + x2, 0) 
Determine which of the following equations defines a linear transformation on the space 
of polynomials @. 


11. A(p) = p(x)? 12. A(p) = x (p(x) 
13. A(p) = p(x + 1) — vp) 14. A(p) = p(& + 1) — pM) 
15. A(p) = ν΄ Ο) — 2p’(x) 16. A(p) = p(x?) 


17. Prove that A: U1 — Vg is linear if and only if 
A(aiX1 + a2X2) = a1A(K1) + a2A(x2) 


for all x1, X2 in Uj, and all scalars aj, ago. 
18. Prove Eq. (2-4). [Hint: Use mathematical induction.] 


19. Let e1,...,e, be a basis for a finite dimensional vector space Ὃ, and for each 
index i, 1 < i’ <n, let n; be an arbitrary real number. Prove that the function 
A: Ὁ — @! defined by 


A(aiei + + +* + Qn€n) = 191 + τ Ontn 
for each vector αἱ} + τ΄ + ane, in Ὃ is a linear transformation. 


20. Let U, be a finite dimensional vector space with basis e1, .. . , n, let U2 be an arbi- 
trary vector space, let y1,..., Yn be vectors in Ue, and for eachx = aje, + °°* + 
Qn€n In U1 set 

A(x) = a1yi +°°° + QnYn. 


Prove that A is a linear transformation from 1)1 to Ve. 


*21. Find all linear transformations mapping 61} into (or onto) itself. [Hint: 1 is a basis 
for ®!.] | 


2-2 ADDITION AND SCALAR MULTIPLICATION 
OF TRANSFORMATIONS 


We begin the systematic study of linear transformations by describing several 
ways in which new transformations can be formed from old ones. Of these the 
simplest is the addition of two transformations, each of which maps a given 
vector space U, into the same space Us. The definition reads as follows: 


Definition 2-2. Let A and B be linear transformations from VU, to Vo. 
Then their sum, A + B, is the transformation from U1 to Ue defined by 


(A + B)(x) = A(x) + BX) (2-6) 


for all x in VU}. 


This, of course, is just the familiar addition of functions here applied to linear 
transformations, and it is an easy matter to show that A + B is again a linear 
transformation from U, to Us. Indeed, if x; and x2 belong to U0, and a, and ag 
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are scalars, then 


(A + B)(ayxy + a2X2) = A(aiX1 + aXe) + Blayx1 + aXe) 
ayA(X1) + αφά(Χ2) + a B(K1) + a2 B(X2) 
α{[4(Χ:) + Bx1)] + a2[A(K2) + B(K2)] 
a1(A + B)(x1) + a2(A + ΒΚ)(Χ)). 

Thus A + B satisfies Eq. (2-5), and is therefore linear, as asserted. 


Ι 


EXAMPLE 1. Let D and D? denote, respectively, the operations of taking first 
and second derivatives in Ὁ ἴα, δ]. Then the sum D? + D is the linear trans- 
formation from 6 ἴα, δ] to C[a, δ] which sends each function y in C7[a, b] onto the 
continuous function y’”’ + γ΄: that is, 


(D? + D)y) = δὲν + Dy. 


EXAMPLE 2. Let K(f) be a fixed function in C[a, δ], and let A be the linear trans- 
formation mapping @[a, δ] into itself given by 


A(f) = [ “ΚΟ dt, a<x <b. 


Then the sum A + J, J the-identity transformation on C[a, δ] (see Example 5, 
Section 2-1), is the linear transformation mapping C[a, δ] into itself whose defining 
equation is 


(A + Df) = [ " K( f(t) dt + ἢ. 


The addition of linear transformations defined above has a number of familiar 
and suggestive properties. In the first place, it is clear that 


A+ (B+ ΟΞ (4 Ὁ 8) Ἐς (2-7) 
and 
A+ B= B+A4A (2-8) 


whenever A, B, and C are linear transformations from 0, to Ug (see Exercise 2). 
Secondly, the zero mapping from VU, to Ὃ 2 defined in Example 4 of the preceding 
section acts as a “‘zero”’ for this addition since 


AtO=O+4A=A4 (2-9) 


for all A: VU; — Ug. And finally, if A is any linear transformation from VU, to 
Us, and if we define — A by the equation 


(—A)(x) = —A(x) (2-10) 


for all x in U,, we obtain a linear transformation from VU, to Ug with the property 
that 
A+ (—A) = -A+A= 0. (2-11) 
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In short, the addition of linear transformations from U, to Vg Satisfies all of the 
axioms postulated for addition in a vector space. 

To complete what should by now be an obvious sequence of ideas we introduce 
a scalar multiplication on the set of linear transformations from U,; to Ug. The 
relevant definition is as follows: 


Definition 2-3. The product of a real number ἃ and a linear transformation 
A: 01 — Vg is the mapping aA from VU, to Ve given by 


(xA)(x) = A(x) (2-12) 


for all x in U,. In other words, aA is the function whose value at x is 
computed by forming the scalar product of a and the vector A(x). 


We omit the proof that aA is linear, as well as the easy sequence of arguments 
required to show that the remaining axioms in the definition of a real vector space 
are now Satisfied. Granting the truth of these facts, we have 


Theorem 2-1. The set of linear transformations from 0 1 to Vg is itself a 
real vector space under the definitions of addition and scalar multiplication 
given above. 


EXERCISES 


1. Cite the relevant axiom or definition needed to justify each step in the proof of the 
linearity of A + B. | 

2. Prove that addition of linear transformations is associative and commutative. 

3. Prove that the mapping — A defined in (2-10) is linear, and that 


A+(-A) = -A+4=0. 


4. (a) Prove that aA as defined in the text is linear. 
(b) Prove Theorem 2-1. 

5. (a) Let X be a nonempty subset of a vector space U;, and let @(X) denote the set 
of all linear transformations A from VU, to Ue with the property that A(x) = 0 for 
all x in X. Prove that @(X) is a subspace of the space of all linear transformations 
from U1 to Ve. | 
(b) What is @(X) when X consists of just the zero vector? When ἃ = V1? 

(c) Prove that @(X) = @(S(X)). 

*6. Let U; and Ve be finite dimensional vector spaces with bases ej,...,e, and 
ej,..-.,€m, respectively. For each pair of integers i, 7, 1 <i<n,1<j<™m, 
define A;;: U1 — Ve by first defining A;; on the basis vectors of 01 according to the 
formula 

’ μὲ = τῷ 
ΓΞ hs if k =i, 
0 if k ¥i, 
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and then use (2-4) to obtain the value of A;; for each x in U;. (See Exercise 20, 
Section 2-1.) 

(a) Prove that the A;,; are linear transformations from U1 to Ue, and that they are 
linearly independent in the vector space of all such transformations. 

(Ὁ) Prove that the 4;; span the space of linear transformations from U1 to Ve, and 
hence deduce that this space is finite dimensional with dimension mn. [Hint: Two 
linear transformations from VU, to U2 are identical if and only if they coincide on 
a basis for Ὃ 1.] 


2-3 PRODUCTS OF LINEAR TRANSFORMATIONS 


The theorem established at the end of the last section would seem to imply that 
the study of linear transformations can be subsumed within the general theory 
of vector spaces. Such would indeed be the case were addition and scalar multi- 
plication the only algebraic operations that could be performed on linear trans- 
formations. However, under suitable hypotheses, it is also possible to define a 
multiplication of transformations. And, as we shall see, this single fact makes their 
study much richer in content and quite different in spirit from that of vector spaces 


alone. 
Vi Vy U3 


FIGURE 2-5 


To introduce this multiplication, let U1, U2, U3 be vector spaces, and consider 
a pair of linear transformations 


A: Ὁ, — Va, B: δ. — V3. 


Then, for each x in U,, A(x) 15 a vector in Us, and it therefore makes sense to 
speak of applying B to A(x) to obtain the vector B(A(x)) in Ὃς (see Fig. 2-5). 
Thus A and B can be combined, or multiplied, to produce a function from Ὃ 1 
to Us which will be denoted by BA, and called the product of A and B in that 
order, viz., first A, then B. This is the content of 


Definition 2-4. If A: U; — Us and B: Us. — Ὃς are linear transforma- 
tions, then their product, BA, is the mapping from VU, to Ὃς defined by 
the equation 

BA(x) = B(A(x)) (2-13) 
for all x in VU. 
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The essential fact about such products is that they are always linear. Indeed, 
if x, and x, belong to U,, and a, and ας are arbitrary real numbers, then 


BA(a1X1 + a2X2) = B[A(a1X1 + α2Χ2)} 
Bla ,A(x1) + a2A(X2)] 
a,B(A(x1)) + a2B(A(x,)) 


a ,BA(x 1) ΠΝ α. ΒΑ(Χ.). 


Hence BA satisfies (2--5), and its linearity has been established. 

Before going any further, a comment on notation is in order. At first sight it 
might seem more reasonable to denote the product of A and B by AB rather than 
BA as above. The explanation for not adopting this notation is quite simple. 
Were it used, (2-13) would have to be changed to read AB(x) = B(A(x)) and 
the writing of equations would then be an open invitation to error. 

Having established the convention that the symbol BA stands for the product 
of A and B, in that order, we observe that this product is defined only when the 
image of A is contained in the domain of B. Thus one of the products AB or BA 
may exist and the other not, a phenomenon which will reappear later when we 
introduce the subject of matrices. But even when both A and B map a given vector 
space into itself, in which case AB and BA are linear transformations on the same 
space, it is by no means true that they must be equal. A simple example of this dis- 
turbing fact can be given in 612 by letting A be a counterclockwise rotation of 90° 
about the origin, and B a reflection across any line through the origin, say the 
x-axis. Then, with e, and 6.9 the standard basis vectors, AB(e,) = e2 while 
BA(e,) = -- 6.9, and AB # ΒΑ. (Picture?) In short, the multiplication of linear 
transformations is noncommutative. 

The foregoing example illustrates one of the ways in _ which this multiplication 
differs from “ordinary” multiplication. Why then call it multiplication at all? 
The answer is provided by the following identities which show that most of the 
properties usually associated with the term multiplication are still valid when 
phrased in terms of linear transformations. Specifically, assuming that all of the 
indicated products are defined, we have 


A(BC) = (AB)C, | (2-14) 
(A; + Ag)B = A,B - AoB, A(B, + Be) = 48. + 48., (2-15) 


(aA)B = A(aB) = a(AB), aascalar, (2-16) 
AI=A 

° J the identity map. 2-17 

ee | y map (2-17) 


The first of these identities asserts that the multiplication of linear transformations 
is associative, the next two that it is distributive over addition, and the fourth that 
it commutes with the operation of scalar multiplication. Finally, (2-17) implies 
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that the identity transformation plays the same role in operator multiplication 
that the number one plays in arithmetic. The reader should note, however, that 
two different identity maps are usually involved here, and, strictly speaking, if 
A: 01 — Ve, then (2-17) ought to be written 


Aly, = A, 
Iy,A = A, 


2 


where Jy, denotes the identity map on U,, Jy, the identity map on U2. But this 
notation is rarely used since the meaning of the unidentified symbol J is always 
clear from the context. 

The proof of each of the above identities is an easy exercise in the definitions 
of the operations involved. Thus to establish (2-14) suppose that C: Ὃ; > Vg, 
B: U2 — Vz, and A: U3 — U4. Then each of the products A(BC) and (AB)C 
is a linear transformation from U, to U4, and to prove their equality we simply 
apply Definition 2-4, twice for each product. This gives 


[A(BC)](x) = A(BC(x)) = 4(B(C@)), 
and 


[(AB)C\(x) = AB(C(x)) = A(B(C(W)), 


and (2-14) now follows from the equality of the right-hand sides of these expres- 
sions. The remaining proofs have been left to the exercises. 


EXAMPLE 1. Powers of a linear transformation. If A is a linear transformation 
on a fixed vector space VU (i.e., 4: Ὁ — V) we can form the product of A with 
itself any finite number of times, thereby obtaining a sequence of linear trans- 
formations on U known as the powers of A. The associativity of operator multi- 
plication implies that each of these powers is independent of the grouping of 
its factors and hence can be denoted without ambiguity by A”, n a positive integer. 
Thus 
AE Anche = AA AS AAW cn 5 


In addition, it is customary to let 443 denote the identity transformation on Ὁ, 
ie., A° = J, so that all of the familiar rules for manipulating (nonnegative) 
exponents become valid. In particular, we have 


A“ A” = AA’ Ἐπ Aas” 
(A”)” a Ae 
for all nonnegative integers m and n. 


EXAMPLE 2. Let D be the differentiation operator on the space of polynomials 
@,. Then D is a linear transformation mapping @,, into itself, and its powers are 
simply the derivatives of orders two, three, etc. Since differentiation lowers the 
degree of every nonzero polynomial by one, the nth power of D maps every poly- 
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nomial in @, onto zero, and D” is the zero transformation on @,. However, if 
n > 1, then D"—!, and hence D itself, is certainly different from zero, and we 
have therefore shown that a power of a nonzero linear transformation may be zero. 


In general, a nonzero linear transformation A: U0 — Ὃ with the property that 
A” = 0 for some n > 1 is said to be nilpotent on VU, and the smallest integer n 
such that A” = 0 is called the degree of nilpotence of A. We call attention to 
the fact that the property of being nilpotent actually depends upon the vector 
space under consideration as well as the linear transformation involved. For 
instance, D is nilpotent of degree n on @,, but is not nilpotent on Φ. (Why?) 


EXAMPLE 3. Polynomials in A. If A is a linear transformation on a vector space 
Ὁ, we can use the powers of A together with the operations of addition and scalar 
multiplication to form polynomials in A. Thus if 


P(X) = αὐ + ayx +++ + apx" 


is a polynomial in x with real coefficients, we define p(A) to be the linear trans- 
formation on VU obtained by substituting A for x in p(x). In other words, 


P(A) = aol + ατά +--+ 4+ a,A", 
OT 
P(A) = ao + 413A + τ.’ + GA", 


the factor J being understood in the first term of this expression just as x° = 1 is 
understood in p(x). Hence if x is any vector in VU, 


p(A)(x) = aox + a,A(x) + τ" + a@,A”(X). 


Multiplicatively, these polynomials obey all of the familiar rules of polynomial 
algebra with the single exception that products can sometimes vanish without 
any of their factors vanishing, as was shown in the example above. In particular, 
the multiplication of polynomials in a linear transformation is commutative since 
the identity p(x)q(x) = q(x)p(x) for “ordinary” polynomials p and g implies that 
P(A)q(A) = q(A)p(A). This, in turn, implies that such polynomials can be factored, 
for, as the reader will remember, factorization of polynomials depends only on 
the commutativity of multiplication and its distributivity over addition. 


EXAMPLE 4. Let C*[a, δ] denote the space of all infinitely differentiable functions 
defined on the interval [a, b], and again let D be differentiation. Then D maps 
©*[a, δ] into itself, and we can therefore form polynomials in D, which in this 
setting are expressions of the type 


a,D”" + a,_,D" 1} +--++ a,D 4+ ao, 


Qo,--+ Qn real numbers. (Such expressions are known as constant coefficient 
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linear differential operators, and it should be observed that they can also be 
interpreted as linear transformations from C"[a, δ] to @C[a, b].) The polynomial 
D? + D — 2isatypical example, and if y is any function in @*[a, b] (or C?[a, b]), 
then 

d’y 


d 
at ge ee 


(D? + --ῶὴν = 


By virtue of the remarks made in the preceding example, we know that 
D? + D — 2 may be rewritten in either of the equivalent forms (D + 2)(D — 1) 
or (D — 1)(D + 2), and in this case it is easy to verify directly that these factor- 
izations are correct. Indeed, 


(Ὁ + 2D — ἣν = (Ὁ + 210 -- τ)» 
ω + η(ῷ. ») 


| 


while a similar calculation yields the equality (D — 1)(D + 2) = D? + ὃ — 2. 


EXAMPLE 5. Let A and B denote the linear transformations mapping @*[a, b] 
into itself defined by 


A=xD+1, B= D— x; 
that is, 


ee, πο ΝΕ 
AY) = xa + J); BY) = 5 XY 
for each y in Θ΄ [α, δ] (see Exercise 4). Then 
480) = (xD + 1(D — x)y] 
d 
(xD + 1) (= - υ) 
d (dy ὄν 
-x4(®-»)+% xy 


d’y 2, dy 
xa t (lL — x) oxy 


I 


[xD? + (1 — x°)D — 2x}y, 


and hence 
(xD + τῷ — x) = xD? + (1 — χὮ ἢ — 2x. (2-18) 
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On the other hand, 

= ΝΕ dy 

BA(y) = ὦ — x) (: a ») 
_d( id ly 
a Φ +») x(x +») 

_ d*y 2, ay 

= χ de + (2 x As — xy 

= [xD? + 0 -- x?)D — xy, 
and hence 

(D — x)(xD + 1) = xD? + (22 — x”)D — x. (2-19) 


Comparing these results, we see that 


(xD + 1)(D — x) Κ (ὃ — χ)ὶχ } + 1), 


and we have another illustration of the noncommutativity of operator multiplica- 
tion. The reader should note that in this case neither the product AB nor BA can 
be evaluated by using the rules of elementary algebra. This is another of the 
unpleasant consequences of a noncommutative multiplication, and, as we shall 
see, has a decisive effect upon the study of linear differential equations. 


In view of the examples just given it is clear that the time has come for us to 
discuss the general problem of functional notation. All of the functions which 
we shall encounter in this text will be elements in one of a number of vector 
spaces, and hence should be denoted by such symbols as f or f(x) were we to be 
inflexible in our use of bold face type. This, however, would ultimately involve 
us in such unsightly (and confusing) expressions as x", sin x, d*y/dx?, So f(x) g(x) dx. 
Such pedantry is pointless, and so we shall use the symbols f and f(x) when in 
our opinion the printed page or its reader would suffer from the use of bold face 
type. Asa general rule, when we wish to call attention to the fact that a function 
is a vector, we shall emphasize it; otherwise, not. 

Finally, to settle notational matters once and for all, we comment on our in- 
tended use (and mild misuse) of the symbols f and f(x). Strictly speaking, f 
should be used to denote a function, and f(x) its value at the point x. But here 
again strict adherence to the letter of the law violates the spirit of clarity of expo- 
sition, for then we would be forced, for example, to write ”, sin , and e where 
everyone expects x”, sin x, and οὖ. We shall not disappoint the reader’s expecta- 
tions on this score either. 


EXERCISES 


1. Cite the relevant axiom or definition needed to justify each step in the proof of the 
linearity of BA as given in the text. 


2. Prove the distributivity formulas (2-15). 
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. Let D and L denote, respectively, the operations of differentiation and integration 


on C“[a, δ]; that is, 


py) = 2. το) = [oa 


for all y in C*[a, δ]. 
(a) Compute the value of LD and DL. 
(Ὁ) Compute the value of 1.5.5 and D“L”, n a non-negative integer. 


. (a) Prove that the mappings A and B defined in Example 5 above are linear trans- 


formations on @%[a, ὁ]. 
(b) Prove that every expression of the form 


An(x)D” + an—1(x)D"—1 + +++ + aiQ)D + ao(x) 


defines a linear transformation from C”[a, δ] to C[a, b] whenever ao(x),... , an(x) 
are continuous on [a, 5]. 


. Write each of the following products in the form ao(x)D? + ai(x)D + ao(x). 


(a) (xD + 1)? 

(0) 2xD + 1)(D — 1) 
(c) ὦ — 1)ῶχ} + 1) 
(ὦ (x?D + 2x)(D — 2x) 
(ὃ) (Ὁ — 2χ) 3} + 2x) 


. Let A, B: U0 — UV be linear, and suppose that AB = BA. Find a formula for 


(A + Δ)", n a non-negative integer. 


. In each of the following find the result obtained by applying the given polynomial 


in D to the indicated functions. 

(a) δ — 1; 2e*, e-*, ο + ο΄: 

(b) D? + 1; sin x + cos x, 2 sin 2x, e* 

(c) (D + 1)(D — 2); sinx + οἴ + e*%, e*, x? 
(d) (D 4- 2)?; ες 22 χο 22, x2e—2 

(e) (xD — 1)(xD + 2); x?, (x3 + 1)/x, e*. 


. (a) Prove that AB = BA for any pair of linear transformations A, B mapping a 


one-dimensional vector space Ὃ into itself. [Hint: Choose a basis for V.] 


(Ὁ) Let U be finite dimensional, with dim‘ > 1. Prove that there always exist 
linear transformations A and B mapping Ὃ into itself such that AB 5 BA. 


. Let A, B, C be linear transformations each mapping a given (unspecified) vector 


space into another vector space, and suppose that each of the products AB and BC 
is defined. Prove that (AB)C and A(BC) are also defined. 

(a) Let A and B be nilpotent linear transformations on a vector space U, and sup- 
pose that 48 = BA. Prove that AB is nilpotent on VU. 

(Ὁ) Give an example to show that the conclusion in (a) may be false if AB + BA. 
Let B be a fixed linear transformation on a vector space U. Show that the set of 
all linear transformations A on VU such that AB = O is a subspace of the vector 
space of all linear transformations on ‘U. What is the subspace if B = O? If B = 1? 
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2-4 THE NULL SPACE AND IMAGE; INVERSES 


Let A be a linear transformation from VU, to Ue, and let 9%(A) denote the set of 
all x in U, such that A(x) = 0. Then, as we have already observed, 9t(A) always 
contains the zero vector of Ὃ:. Actually we can say much more than this, for if 
A(x1) = A(X2) = 0, then 


A(ajX1 + a2X2) = a1A(K1) + a2A(X2) = 0 


for all scalars a1, ag, and it follows that 9t(A) is a subspace of Ὃ.. This subspace 
is called the null space or kernel of A, and is of fundamental importance in studying 
the behavior of A on Uj. 

Of equal importance with the null space of A is its image, 9(A), which, we recall, 
is the set of all yin Ὃ 2 such that y = A(x) for some xin Ὃ ;. It too is a subspace— 
this time in U,.—since if y; and γ. belong to 9(A) with y; = A(x,), yo = A(Xo), 
then 

A(aiX1 + α2Χ2) = a@A(K1) + αρΆ(Χ2) = αν + aya, 


and a1y1 + a@2Yz2 15 also in the image of A, as required. 


EXAMPLE 1. Let 7: Ὁ — Ὃ be the identity transformation. Then 9t(/) = 0, 
the trivial subspace of Ὃ, while 9(//) = Ὁ. 


EXAMPLE 2. If O: VU, — Vg is the zero transformation, then, by its very defi- 
nition, ὅ1(0) = Vy, 9(O) = ©. 

EXAMPLE 3. Let D be the differentiation operator on the space of polynomials 
@,. Then the null space of D consists of all polynomials of degree zero together 
with the zero polynomial, while its image consists of the zero polynomial and all 
polynomials of degree < n — 1. 


EXAMPLE 4. Let ©?(— oo, 00) denote the space of all twice continuously differen- 
tiable functions on (— 00, 00), and let A: C?(— οὐ, οο) — Θ(-- οὐ, ow) be the linear 
transformation D* — J. Then 


d*y 
40) = Ga — 7 


and the null space of A is the set of all functions y in C?(— οὐ, οο) for which 


15. Ὁ. Ὁ 

Thus, 9t(A) is the set of solutions of a certain differential equation, and the prob- 
lem of finding all solutions of this equation is identical with that of finding the 
null space of δ — 7 


EXAMPLE 5. Let Θ᾿ be the space of all infinite sequences {x 1, x2, x3,...} of 
real numbers, with addition and scalar multiplication defined termwise (see 
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Exercise 8, Section 1-2), and let A and B be the linear transformations on ®” 
defined by 


A{x 1, X2, X%3,.--$ = {Xay χα X4,---}5 
B{xy, Χο, ΧΕ... } ΞΞ {0, Χι. Χχος.. ἢ; 


Then 91(4) is the subspace of ®® consisting of all sequences of the form 
{x,,0,0,...}, with x, arbitrary, while ὅ1(8) = 0. On the other hand, 9(A) = 6", 
while, by definition, 9(B) consists of all sequences whose first entry is zero. 


Now that we have introduced the null space and image of a linear transforma- 
tion we propose to take a closer look at those transformations A: U; — Vg for 
which either 

(i) MA) = 9, or (ii) 9(A) = Vo, 


or both. The second of these equations asserts that A maps Ὃ 1 onto Us, and implies 
that for each y in Uz there exists at least one x in U,; such that y = A(x). The 
first, which says that the null space of A contains only the zero vector, turns out 
to be equivalent to the assertion that A is one-to-one in the sense of the following 
definition. 


Definition 2-5. A linear transformation A: U; — Vg is said to be one- 
to-one if and only if A(x,) = A(X2) implies that xy = Χο. 


In other words, A is one-to-one if and only if A maps distinct vectors in U, onto 
distinct vectors in U2; whence the name. (See Fig. 2—6.) This said, we now prove 


Theorem 2-2. Α Jinear transformation A: 0, — Ug is one-to-one if and 
only if S0(A) = Θ. 


Proof. Let A be one-to-one, and suppose that A(x) = 0. Then A(x) = A(0), and 
Definition 2-5 implies that x = 0. Thus 91(A) = ©. Conversely, if (A) = ὃ 
and A(x ,) = A(x2), then A(x;) — 4(Χ9) = 0, or A(x1 — Χο) = 0. Thus 
ΧΙ — Xo = 0, and x; = Xo, as asserted. ἢ 


Vy Vo Vy Ὅς 


A(xX;)= 
A(X9)= A(X3) 


One-to-one Not one-to-one 


FIGURE 2-6 
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Among the various transformations appearing in the examples above, only 
B: 6.5 — δ and J were one-to-one, since only they had trivial null spaces. 
Additional examples of such transformations are provided by rotations of 65 
about the origin, reflections across any line through the origin, etc. The reader 
should have no difficulty in augmenting this list indefinitely. 

Linear transformations which are both one-to-one and onto are called iso- 
morphisms, and are said to be invertible. They are of particular importance since, 
just as with ordinary one-to-one onto functions, they have inverses, and all of 
the standard facts concerning inverse functions can then be established. Indeed, 
if A: Ὃ; — Ὃ is one-to-one and onto, each vector y in Ug is paired with a unique 
vector x in U,, and A can therefore be used to define a function from VU, to Ὃ 1. 
This function is called the inverse of A, and is denoted by A~! (read “4 inverse”). 
It can be described explicitly as the function from U2 to VU, such that 


A~(y) = x, | where A(x) = y (2-20) 


for each y in Us. Loosely speaking, A~! is obtained from A by reading the 
definition of A from right to left, as suggested in Fig. 2-7, and is clearly a one-to- 
one map of U2 onto U,. Moreover, it is linear, since if y; and y2 belong to Us 
with y; = A(x,), Ye = A(X), then 


A(ayX1 + α2Χ2) = αι + ao, 
and (2~—20) implies that 
ΑΓ ἴ(αινι + α25.) = αἰχι  αὐΧ = aA 1(¥1) + ας4 (yo). 


Having observed that A~! is one-to-one, 
onto, and linear, it follows that it too is in- 
vertible, and if we simply parrot the construc- 
tion given above, this time starting with A}, 
we find that (A~')~! = A. Finally, if we 
form the products A~14 and AA™1, each of 
which is certainly defined, an easy argument 
reveals that they both reduce to the identity; 
that is, 


A'A(x) =x and AAy)=y 


for all x in U, and all y in Ὁ... And with this 
we have proved the following theorem. FIGURE 2-7 


* These equations are the vector space analogs of such pairs of statements as 


sin! (sin x) = x, sin (Sin-! x) = x, —@7/2< x < 7/2, 
or | 
elnz = x, In (e7) = x, 


which are familiar from calculus. 
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Theorem 2-3. Every one-to-one linear transformation A mapping 0, onto 
Us has a unique inverse from Uz to VU, defined by 


A~'(y) = x, 


where A(x) = y for all y in Uy. ΑΓ is also one-to-one, onto, and linear, 
with (A—')—! = A, and 


A~'A = Ip, AA = 1, (2-21) 
where 10, and 10. denote, respectively, the identity maps on 0; and Ὃ 2. 


These last equations actually serve to characterize invertible linear transforma- 
tions—a fact which when stated precisely reads as follows: 


Theorem 2-4. Let A: Ὃ — Vs and B: V2 — V, be linear, and suppose 
that BA and AB are, respectively, the identity maps on ‘0, and U2. Then A 
is one-to-one and onto, and B = 4". 


Proof. Let x in UV, be such that A(x) = 0. Then on the one hand, 


B(A(x)) = B(0) = 0, 
and on the other, 
B(A(x)) = BA(x) = I(x) = x. 


Thus x = 0, and 51(4) = ὁ. | 
Now let y be an arbitrary vector in Up. Then 


y = 70) = 486) = A(BQ)), 


and it follows that y is the image under A of the vector B(y) in U,;. Thus 9(4) = Vo, 
and we are done. J 


EXAMPLE 6. If A is any rotation of ®? about the origin through an angle @, 
then A is invertible with A—! the rotation through — 6, since A~'A = 441 = I. 


EXAMPLE 7. Let A: 6 — 6.5 be defined by 
A(X1, ΧΩ, X3) = (X1 + Xe, Xe, X3). 
Then Α is invertible, with A—* given by 
. A~*(x1, X2, X3) = (41 — X2, X2, X23), 
since 


A~*A(xi, ΧΩ; x3) ἘΞ (x1, X25 x3) = AA~*(x1, X25 ΧΆ). 


Theorem 2-4 suggests a natural and valuable generalization of the notion of 
the inverse of a linear transformation A: U; — Ug; to wit, a linear transformation 
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B: Ve V1 such that 
AB = 7, BA # I. 


The fact that such transformations do exist can be seen by looking at Example 5 
above where 

AB{X 1, Xo, X3,..-$ = {X1, Xo, X3,...}, 
and 

BA{x , Χο, X3,..-} = {0, Xo, X3,...}. 


Transformations of this sort are encountered fairly often in certain types of prob- 
lems and are therefore distinguished by name according to the following definition. 


Definition 2-6. A linear transformation B: Uz — Ὃ; is said to be a right 
inverse for A: U1 — Ve if the product AB is the identity map on Vg». 
Similarly, B is said to be a left inverse for A if BA is the identity map on Ὁ 1. 


Remark. If B is a right (left) inverse for A, then A is a left (right) inverse for B. 


The example given a moment ago shows that a linear transformation may have 
a right or left inverse without having an inverse. It is easy to show, however, 
that if A has both a right inverse B and a left inverse C, then A is invertible, and 
B= C = 4}. For then 
AB = J and CA = IJ, 
and it follows that 
C(AB) = CI = C, (CA)B = IB = B, 


and hence that B = C. Thus AB = BA = J, and the assertion that A is invertible 
with B = C = 4. 1 now follows from Theorem 2-4. 


EXAMPLE 8. Let @*[a, b] be the space of infinitely differentiable functions on 
[α, bj, and let D and L be differentiation and integration, respectively ; that is, 


Dy = 7° Ly = [[γῶ αι. 
Then : 
LDQ) = [-: 5) αἱ = yx) -- γί, 


while 
DL) -- ἧς |” yt = yO, 


and it follows that DL = J, LD σέ I. In other words, the operation of integration 
on function spaces is only a right inverse, and not an inverse, for differentiation. 
It is this fact more than any other which motivated us to introduce the notions 
of right and left inverses in the first place. 
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EXERCISES 


1. 


Find the null space and, where applicable, the inverse of each of the following linear 
transformations on 62. 


(a) A(xi, x2) = 2(%1, —*x2) 

(Ὁ) A(x1, x2) = (x2, 0) 

(c) A(x1, x2) = (αι + x2, x1 + X2) 
(ὦ A(x1, x2) = (αι + x2, x1 — ΧὩ) 


. Repeat Exercise 1 for the following transformations on R3. 


(a) A(x1, χα, x3) = (χι + X2, x2 + x3, 1) 

(Ὁ) A(x1, x2, x3) = (2x1, —x3, x1 + 3) 

(c) A(x1, x2, x3) = (x2 + 2x3, x1 — X2, 0) 

(ἃ A(xi, x2, %3) = (41 — X2, x1 + x2 + X3, ΧΩ + x3) 


. Repeat Exercise 1 for the following transformations on @. 


(Ὁ) A(p) = xp) 
(c) A(p) = p(x) — pO) 
(d) A(p) = p(x)q(x), g(x) a fixed polynomial in @ 


4. In giving the definition of 41 we insisted that A be one-to-one. Why? 


10. 


11. 


. Let A: 2 — 62 be defined by 


A(x1, X2) = (αιχι + ae2xe, Bix1 + Box2), 


where a1, a2, 81, 82 are real numbers. Prove that A is linear, and find a necessary 
and sufficient condition in terms of a1, a2, 81, 82 for A to be invertible. 


. Let A: U1 — Ve be linear, let W be a subspace of U1, and let A(W) denote the 


image of W in Ug; i.e., A(W) is the set of all vectors y in U2 such that y = A(w) 
for some w in‘W. Prove that A(W) is a subspace of Ue. 


. Let A:U1 — ὍὋ be linear, and let WW be a subspace of U2. Prove that the set of all x 


in VU, such that A(x) belongs to W is a subspace of 01. 


. Let A: U1 — Ug be a one-to-one linear transformation, and let e1,...,¢e, be 


linearly independent vectors in ‘U1. Prove that A(e1),..., A(en) are linearly inde- 
pendent in Uo. 


. Let A: Ui — Ug be linear, and suppose that 


dim U0; = dimVz:z =a < ο. 


Prove that A is one-to-one if and only if it is onto. [Hint: See Exercise 8.] 


Let A and B be invertible linear transformations mapping Ὃ onto itself. Prove that 
AB and BA are also invertible, and that 


(AB)-! = Βπ1ι4-πι, (BA)~! = 4-||8-1. 


Let 4: Ὁ —W be linear, and suppose that A? + 7 = A. Prove that A is 
invertible. 
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*12. (a) Let Ue be finite dimensional, and let 4:U 1 — Ue be one-to-one. Prove that 
A has a left inverse but not a right inverse whenever 4(4) ¥ U2. [Hint: Choose 
an appropriate basis in U2.] 

(Ὁ) Now let 0, be finite dimensional, and suppose that A is onto. Prove that A has 
a right inverse but no left inverse whenever 91(4) # ©. 

13. A linear transformation P: U — Ὃ is said to be idempotent if and only if P? = P. 
(a) Prove that P is idempotent if and only if J — P is. 
(Ὁ) Prove that 1((P) = JU — P), and that J(P) = ICU — P) whenever P is idem- 
potent. (Hint: The image of P consists of all x in U such that P(x) = x.] 
(c) Use the results of (Ὁ) to show that every x in VU can be written uniquely in 
the form 


X = X1 + X2 


with x1 in 9U(P), x2 in J(P) whenever P is idempotent. 

14. Let U be finite dimensional, and let W be a subspace of VU. 
(a) Prove that there exists a linear transformation P: Ὃ — W such that 9(P) = W, 
and P(x) = x for all x ἰὴ Ἂν. A linear transformation of this type is said to be a 
projection of © ontoW. [Hint: Choose a basis for W, and extend to a basis for U.] 
(Ὁ) Prove that a linear transformation P on VU is a projection onto a subspace ἊΝ 
if and only if P is idempotent and‘W = 9(P). (See Exercise 13.) 

15. Two vector spaces U1 and 1). are said to be isomorphic if and only if there exists 
an isomorphism 4: Ὃ: — Vo. 
(a) Prove that two finite dimensional spaces U1 and U2 are isomorphic if and only 
if dimU; = dim Vg. 
(Ὁ) Let ®* denote the space of Exercise 10, Section 1-2. Prove that R+ and 41] 
are isomorphic by exhibiting an isomorphism 4: 61 Ὁ -- 6}. 
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Until now we have carefully refrained from using bases and coordinates in our 
study of linear transformations in order to avoid subverting our results by tying 
them to a particular choice of coordinate system or suggesting that they are 
valid only for finite dimensional spaces. But as everyone knows full well, coordinate 
systems are invaluable in computations, and we therefore propose to devote the 
remainder of this chapter to exploring some of the connections between linear 
transformations and bases. In so doing we will be led to the notion of a matrix 
and to the subject of matrix algebra, which can best be described as the arithmetic 
of coordinatized linear transformations. Thus we now impose the restriction 
that every one of the vector spaces encountered in the several sections which 
follow 15 finite dimensional unless explicitly stated otherwise. 

With this restriction in force, let A be a linear transformation from VU, to Us, 
and let e;,...,¢e, be a basis for U,. Then if 


X = XQ, +°°° + Xnen 
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is any vector in U1, 
A(x) = x1A(€1) + +++ + XnA(En), (2-22) 


and it follows that the value of A(x) is completely determined by the vectors 
A(e;),..., A(€n) in Ug; 1.6., A is uniquely determined by its values on a basis 
for U,. Moreover, if y,,...,Yn are arbitrary vectors in U2, the mapping 
A: 01 — Vz defined by setting 


A(e,) = Y1,.--- . A(en) = Yn; 


and then using (2~—22) to compute the value of A(x) for every x in VU, 15 clearly 
linear. Thus Eq. (2-22) also tells us how to construct all linear transformations 
from Ὃ: to U2, and we have proved 


Theorem 2-5. Every linear transformation from Ὅ to Ve is uniquely 
determined by its values on a basis for © 1. These values can be chosen 
arbitrarily in ©», different choices yielding different transformations, and 
every linear transformation from ὍὋ 1 to Uz can be obtained in this way. 


EXAMPLE 1. Let e, and eg be the standard basis vectors in ®”, and let A be a 
linear transformation from ®? to Θ΄. Then A is completely determined by the 
pair of real numbers A(e,), A(e2), and can therefore be represented by the ordered 
pair (A(e;), A(e2)). Since distinct ordered pairs define distinct linear trans- 
formations, it follows that there are exactly as many linear transformations from 
6.2 to R! as there are vectors in R”. 


EXAMPLE 2. Let A: 62 > 6.32 be the linear transformation defined by 


A(e1) = (a1, a2), 
A(€2) =F (81, B2), 


where e, and 6.5 are the standard basis vectors, and let 


Χ = Xe; + X2€2 
be any vector in ®?. Then 


A(x) x A(e,) + x2A(€2) 
χι(αι; a2) ΞΕ χαίβι, Be) 


(αιχι + BiX2, a2X1 + Box). 


In this case A can be represented by the array of scalars 


be Ἵ ᾿ 
ag Be 


and every such array can be viewed as the definition of a linear transformation 
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A of &? into itself where 
A(X1, ΧΩ) = (a1X1 + BiX2, agxX1, + B 2X2). 


EXAMPLE 3. Let A: 65 — σ΄ be the linear transformation described by the 
ordered pair of real numbers (2, —1) with respect to the standard basis in ®?; 
that ts, 

A(ei) = 2, Aes) = --- 


and lete; = e; + e2,e, = —e,. Thenei, e; is also a basis for R2, and we have 


A(ei) = A(ei) + Alea) = 
Α(62) = —A(ei) = — 


Thus the ordered pair which describes A with respect to the basis 61, 62 is (1, —2), 
and we see that the description of a linear transformation by means of its values 
on a basis changes with a change of basis. 


EXERCISES 


1. Let A: 2 — σι" be represented by the ordered pair of real numbers (a1, a2) with 
respect to the standard basis in ®?, and let 8: R? — R! be represented by (81, 82). 
Show that aA is represented by (aa1,aa2), and that A + Δ is represented by 
(ai + B1,a2 + Be). 

2. Let 4:65 — 4! be represented by the ordered pair of real numbers (a1, a2) with 
respect to the standard basis in R?. Find a necessary and sufficient condition that 
there exist a basis ej, e2 in R? with respect to which A is represented by (1, 1). As- 
sume that this condition is satisfied, and find ο΄, οὐ. 


3. Let A: R? — 4.2 be represented by the array 


: ᾿ 
a2 Be 


and let 8: 6.2 — 412 be represented by 


: A 
aa Bo 

Find the representation of aA, A + B, and AB. 
4. Let £(R?, R!) denote the vector space of all linear transformations from 6132 to 611, 

and let 

T: £(R2, R!) 5 R?2 
be defined by 
T(A) = (αι, a2), 


where (a1, a2) is the ordered pair of real numbers which describes A with respect to 
the standard basis in 612. 
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(a) Prove that T is a one-to-one linear transformation mapping £(R?, R}) onto R2, 
and hence deduce that dim £(R?, R!) = 2. [Hint: See Exercise 1.] 


(Ὁ) Use the result in (a) to find a basis 41, 42 in (6,3, R') which corresponds to 
the standard basis in 6.2. What is the effect of A; on the vector (1, 1) ἴῃ 6122 Of Ao? 


Ἐς Generalize the technique used in the preceding exercise and show that there exists a 
one-to-one linear transformation mapping £(R?2, 612) onto R*. What is the dimension 
of £(R2, R2)? 


2-6 MATRICES 


We have seen that every linear transformation A: U; — U2 can be obtained from 
the formula 
A(x) = x;A(e1) + τ" + Xn A(En) (2-23) 


by suitably choosing the A(e;) in Ug, and that (2-23) defines a linear transforma- 
tion from U to Us for every choice of these vectors. (Recall that e;,...,€, is a 
basis for U,, and that x1,...,X, are the coordinates of x with respect to this 
basis.) We now use this observation to define the notion of a matrix for a linear 
transformation, as follows. 

Let f1,... fm be a basis for Ug, and let A: Ὃ; — Uz be given. Then, for each 
integer j, 1 < 7 < a, there exist scalars a;; such that 


A(e;) = > aiifi, (2-24) 
i=l 


1.e., such that 
A(e1) = ayify + aeife “Θ΄ + Qmifn, 
A(C2) = ayofi + agefe + -+* + omafm: (2-25) 


A(en) = Oink + αοιΐο ae + Omnkm.- 


For computational purposes it turns out to be convenient to display these scalars 
in the rectangular array 


bee αιὸ °** Qin 
Q21 O22 Γ᾽ Gant, (2-26) 
εἶ αι 5 Amn 


whose columns are the coefficients of the various equations in (2-25). The reader 
should note that the first subscript on an entry in (2-26) indicates the row in which 
that entry appears, and the second indicates the column. With this convention in 
force the entire array can be abbreviated (a;;), it being understood that i and j 
range independently over the integers 1,..., mand l,...,2, respectively. When 
displayed as above, this set of scalars is called the matrix of A with respect to the 
bases@®, = {e1,..., en} and By = {f1,..., fm} and is denoted by [A: @1, Bol, 
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or simply by [A]. (In the special case where A maps Ὃ into itself and ®; = ὦ. = B, 
the notation [A: Φ] is also used.) When m = n, we say that (2-26) is a square 
matrix; otherwise, rectangular. In general, a matrix consisting of m rows and n 
columns will be referred to as an m X n-matrix (read “m by n’’). 

The argument just given shows that every linear transformation from U,; to Us 
determines a unique m X n-matrix with respect to ὦ; and ®g. But since the α;; 
in (2-25) uniquely determine the A(e,;) and hence, by (2-23), A(x) for all x in 0), 
it follows that every m X n-matrix determines a unique linear transformation from 
U, to Us in terms of ®,; and ὦ, and we therefore have 


Theorem 2-6. Let Ὃ, and Vz be finite dimensional vector spaces with 
dim U; = ἡ, dim Ug = γι, and let @, and @z be bases for ©, and Vo, 
respectively. Then every linear transformation from 0, to Us determines 
a unique m X n-matrix with respect to ®, and ὦ, and, conversely, every 
such matrix determines a unique linear transformation from Ὃ to Vo 
defined by (2-23) and (2-24). 


It is important to realize that this theorem does not assert that every linear 
transformation has a unique matrix. Indeed, any such assertion would be patently 
false, for, as we have already seen, the matrix of a linear transformation can 
change with a change of basis (Example 3, Section 2—5). Thus the several references 
to bases which appear in Theorem 2-6 cannot under any circumstances be deleted. 


EXAMPLE 1. Let δι and 6.9 be the standard basis vectors in ®”, and let 
A: 4.3 — 62 denote the reflection across the e,-axis. Then 


A(e;) = 1:6. + 0- eg, A(€o) = O0-e, — Ἰ ’ 69, 


and the matrix of A with respect to the basis 61, 6. is 


F | 
0 --ἰ 
EXAMPLE 2. Let A: 42 -» 62 be the (counterclockwise) rotation about the 
origin through an angle 6, and again let 
e, and eg be the standard basis vectors. 
Then 
A(e;) = (cos θ)6: + (sin A)eo, 
A(eo) = —(sin θ)6} + (cos A)eg 


(see Fig. 2~8), and the matrix of A with 
respect to this basis is 


cos@ —sin ἡ 
sin θ cos 6 


FIGURE 2-8 
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EXAMPLE 3. If J is the identity map on WU, then, regardless of the basis used, 
the matrix of J is the nm X n-matrix 


0 --- 0 
01 -.--.-- 0 
090... 


with ones along its principal diagonal and zeros elsewhere. For obvious reasons 
this matrix is called the n X n-identity matrix. 

Similarly the matrix of the zero transformation from U, to Ug is always the 
the m X n-zero matrix 


0 
0 
0 0 0 
EXAMPLE 4. Let 
D: Pn — On 


be differentiation, and let 
GH diye χ 


be the “‘standard”’ basis. Then 


Ρ = 0-1 + 0-x +--+ + 0-x7-?2 + 0: x", 
D(x) = 1-1 4+ 0-x +-+- + 0-x"7? 4+ 0-x"7?, 
D(x?) = O-L + 2x +--+ + 05x"? + 00x77}, 


ραν ἢ = O-1 +O-x tee + ἃ -- Dx” 2 4:0: x77, 


and 
1 O 0 
0 2 0 
[D: Φ] = 
060. n— | 
0 0 - 0 
“EXAMPLE 5. Let 
A: P3— 85 


be the linear transformation defined by 


A(p(x~)) = Ὡχ" — 3,»0) 
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for all p(x) in @3, and let ®; and @g be the standard bases in ®3 and @;5, respec- 
tively. Then 


A(1) = 2x7 —3 = -3-14+0-x+2:x7 40-7 4+0-x?, 
A(x) = 2χ" — 3x = 0-1 —3-x+0-x74+2-x° +0- x4, 
A(x”) = 2x* — 3x7 = 0-14+0-x — 3-x7 + 0-x? + 2- χῇ 


and 
—3 0 0 
0 —3 0 
[A: ®1, Be] = 2 0 —3 
0 0 
0 oO 2 
EXERCISES 


In Exercises 1 through 6 find the matrix of the given linear transformation with respect 
to each of the given pairs of bases. 


1. 4:68 - αι; A(x1, χα, x3) = (x1 + χα, x1 + x3, 0) 


(a) Ὁ: and . the standard basis 


(1, 1, 0) 
(Ὁ) ὦ; the standard basis, Be = ~(1, 0, 1) 
(0, 0, 1) 
(1, 1, 0) (1, 0, 0) 
(0) ®1 =40,0,1), ὥς = 41, 1,0) 
fae τὸ 


. 4:68 - σι; A(x1, x2, χ8) = (x1 — χω, 2x2 — 3x3) 


(a) ®1 and @e the standard bases 


(i, 1, 0) 
(Ὁ) ὦ, = (C1, 0, 1), @2 = the standard basis 
(0, 1, 1) 
(i, 1, $) 
() ι =1@,-1,-1), 4 = ie 
(3, 2, 2) ° A 


. A: 03 >}; A(p(x)) = Sb pd dx 


(a) Bi = {1, x, x) Be = {1} 
(0) ®1 = {1,x — 1, x(x — 1}, Be = {}} 
(Cc) Bi = (,ἃχ — 1,x@ — I}, Be = {2} 


68 
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. A: 03 > 1; A(p(Xd)) = Sti pO) dx 


(Ὁ) ὦ: {1..Χ; x? — τὰ Be = {1} 
(c) ®1 {1,x + 1,x? — 1}, Θ. = {--2} 


. A: 03 > Ca; A(p(x)) = (x? — 1)» 0) 


(a) ®1 = {1, x, x7}, Be = {1, x, x*, x3} 
(b) ὦ: = {1, x, baal Bo = {1, x or 1, (x - 1)2, (x = 1)3} 
(c) ®1 = {1,x — 1, (x — 1)7}, Be = f1,x — 2, -- 2)2,(@ -- 16 -- 2) 


. A: 03 > 04; A(pX) = fo pO at 


(a) Qi = il, x, x}, Be = il, x, xe, x} 
(Ὁ) ὦ: = {1, x, x7}, Be = {1, x, x?/2, x3/3} 
(c) @1 {2x — 1,2x + 1, x(x + 1}, Be = {x — 1, x - 1, x?, x9/3} 


. Find the value of A(x) for any x in U1, given that 4: Ὃ: — V2 is linear, and 


[A: 81, Ba] = (iy). 


ΓΑ subspace W of a vector space Ὃ is said to be invariant under a linear transforma- 


tion 4: Ὃ — Ὃ if and only if A(w) belongs to W for every w in W. 

(a) Every linear transformation 4: Ὃ — Ὃ has at least two invariant subspaces. 
What are they? 

(b) Give an example of a linear transformation on a finite dimensional vector space U 
which has exactly two invariant subspaces. (Do not assume dim‘0 = 1.) 

(c) Let dimU = n, dim‘W = γι, and suppose that W is invariant under 4: Ὃ — Ὁ. 
Prove that there exists a basis ὦ for U such that 


Qit 5 Alm QA@l,m+1 oe 8 Ain 
αι] °°* ABmm Am,m+1 °c Amn 
[A: ὦ] = 
O sts O αν, °*° Am+1,n 
0 <= 0 @am4i ht. eee: 


[Hint: See Theorem 1-7.] 


(4) Let 1 and ‘We be invariant subspaces of U under A, and suppose that 
(i) dimW 1 = m, dimW2 = n — m, wheren = dim, 
(ii) WW 1 and ‘W2 have only the zero vector in common. 

Prove that there exists a basis ὦ for U such that 


O11 Aim 0 0 
AQm1 Amm 0 0 
A: Φ] = 
0 0 QAm+1,m+1 Om+1,n 
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2-7 ADDITION AND SCALAR MULTIPLICATION OF MATRICES 


Let £(V 1, Us) denote the set of all linear transformations from 0, to Us, and 
let Minn denote the set of all m X n-matrices. Thenif dim U, = nand dim Ὃ 9 = m, 
Theorem 2-6 asserts that the function which associates each A in L(V), Va) 
with its matrix [A] with respect to a fixed pair of bases ®,; and (3. is a one-to-one 
mapping of £(UV 1, Us) onto Mmn. This simple fact allows us to translate algebraic 
statements concerning linear transformations into statements concerning matrices, 
and leads to the subject of matrix algebra. In particular, it allows us to convert 
Wmn Into a real vector space by using the matrix analogs of the addition and 
scalar multiplication in (Ὁ, U2) to define an addition and scalar multiplication 
for matrices. The argument goes as follows. 

Let (a;;) and (6;;) be arbitrary m X n-matrices, and let o be a real number. 
Then by choosing bases in 0, and Vg we find unique linear transformations A and 
Bin £(0 4, Ug) such that 


[4] = (a:;), [{8] = (6:3). 
Thus, using the notation of the preceding section, we find 
A(e;) = Σὺ afi,  Ble;) = > Bishi, 
ἐπεὶ ἐπεὶ 


and it follows that 
(A + Byje;) 


I 


A(e;) + Ble;) 


= δ) afi t+ >> Bis 
i=l i=l 


= D> (ay + Bifi 


t=1 


and 
(cA)(e;) = o (> afi) 
| i=1 
= DD (oa;;)fi. 
i=1 
Hence 


[A + 8] = (aij + Bis), 
[7A] = (Ga;;), 
and if we now require, as reason dictates we must, that 
[A] + [8] = [4 + B], and o[A] = [oA], 


we are forced to give the following definition. 
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Definition 2-7. The sum (a;;) + (@;;) of two m X n-matrices is by defi- 
nition the m X n-matrix (a;; + βι)); the product o(a;;) of a real number σ 
and an m X n-matrix is by definition the m X n-matrix (a;;). In other 
words, 


(aij) + (Biz) = (αῃ + Bis) (2-27) 


and 
o(aij) = (σαι) (2-28) 
for all m X n-matrices (a;;), (8;;), and all real numbers σ. 


When expressed as rectangular arrays these equations become 


Qj, τῷ *** Qin Bi1 Big *°° Bin 
αοὶ αὐ °*'* Qan 2: βει Bea °°: Ban 
Qm1 ἀρ 7) Amn Bm1 Bm2 ΝΣ Benn 
O11 + Bir O12 + Big τ᾿ Gin + Bin 
αοι + Be1 G22 + Boag τ᾽ Gan + Ban 1: 
Am1 ὌΝ Bm1 Am2 + Bme "ee Amn + Binn 
and 
αιι ατὸ “°** Ain O01; O12 5 JGAjn 
᾿ αὶ O22 5 Aan} _ O02; Ga22 °*** Than}; 
Qm1 A&m2 %°°° Amn σαι σαρ 5 TJTAmn 


and assert that matrix addition and scalar multiplication are performed entry by 
entry, or termwise. Moreover, we now have 


Theorem 2-7. The set Mmn of all m X n-matrices is a real vector space 
under the above definition of addition and scalar multiplication. 


The student should appreciate that there is no need for a formal proof at this 
point since the asserted result follows automatically from Theorem 2-6, the fact 
that £(U1, Us) is a real vector space, and the way in which addition and scalar 
multiplication were defined in Sn. Indeed, we can now assert that (Ὁ, Ua) 
and SWmn are algebraically identical (or isomorphic), and that the function which 
sends each linear transformation 4: U; — Ue onto its matrix [A: @1, Be] with 
respect to a fixed pair of bases ®, and @g is an isomorphism of £(01, Ue) onto 
| | ere 
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As an illustration of the way in which this fact can be used to establish results 
which are not otherwise obvious, we now propose to show that £(U1, U2) is finite 
dimensional and to compute its dimension. For this purpose we introduce the 
special matrices (e;;), 1 <i<m,1 <j <n, each of which has the entry 1 at 
the intersection of the ith row and jth column and zeros elsewhere: 


J 
0 : O 
ἤτον. 2 +++] = (ez). (2-29) 
0 : 0 


Then, for each (a@;;) in Wmn we have 


(a;;) = a41(€11) SF aie a1n(C1n) 
+ aegi(€21) + °°+ + ean(C2n) 


+ Om1(€m1) ae ape Qmn(Cmn)s 
or 


(ais) = Dy ass(esi). (2-30) 
4,j=1 
Thus the (e,;) span 3% mn, and since it is clear that (2-30) is the only possible way 
of writing (a;;) aS a linear combination of the (e;;), it follows that these matrices 
are a basis for Mmn- (This particular basis is called the standard basis for Mmn.) 
Hence £(0 1, Ug) is also finite dimensional with dimension mn, and we have 
proved | 


Theorem 2-8. Jf Ὁ, and Uz are finite dimensional vector spaces, then so 
is (Ὅτ, U2), and 


dim £(U1, Us) = (dim 0;)(dim V9). (2-31) 


EXAMPLE 1. The set of all 1 Χ n-matrices 911, 1s an n-dimensional vector 
space with 

(11) = C,0,...,9) 

(612) = (0,1,...,9) 


(€1n) τες (0,0,. δου ς 1) 


as a basis. In this case the (e;;) can be identified with the standard basis vectors 
in ®&”, and when this identification is made 9%,, becomes identical with &”. 
Thus £(0, ®') is isomorphic with ®”, whenever dim Ὃ = n, and we conclude 
that there are exactly as many linear transformations from to δι᾽ as there are 
vectors in ®” (cf. Example 1, Section 2-5). 
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EXAMPLE 2. Let 
V1 = Vo = R?, 


Then dim (σι, 6.2) = 4, and the (e,,;) are four in number: 


1 0 0 1 
(611) = Η (612) = ᾿ i 

0 0 ‘10 0 
(621) = Ἷ ἡ (652) = ᾿ ‘| 


Moreover, if E;; denotes the linear transformation corresponding to (65) with 
respect to a fixed basis in ®?, then every linear transformation mapping ®? into 
itself can be written uniquely in the form 


011611 + ayeF 12 + ae1Fe1 + ae2F 92 


for suitable scalars α11, @19, @21, 52. 


EXAMPLE 3. If Aisa nonzero linear transformation mapping a finite dimensional 
vector space Ὃ into itself, then 


TAA χε As 


also map Ὃ into itself, and thus belong to (Ὁ, Ὁ). But by Theorem 2-8 this set 
is linearly dependent in £(U, UV). Hence there exists a smallest positive integer k 
such that 4 is linearly dependent on J, A,..., A*—!, and it is now easy to show 
that these transformations are a basis for the subspace of £(V, 0) spanned by 
the powers of A (see Exercise 14). In particular, we can write A” in the form 


A*® = a,_yA*) + --- 4+ aA + aol, 
Or 


A* — a,_,A*-! — +--+ — a,A — ἀρ = Ο, (2-32) 


where O is the zero transformation on VU, and it follows that A is a root of the 
polynomial 
ma(x) = x* — ag_yx") — +++ — ayx — ao. (2-33) 


Since k was chosen as small as possible in this argument there is no polynomial 
of lower degree having A as a root. For this reason m,(x) 15 called the minimum 
polynomial of A. It can be characterized as the polynomial of Jeast degree with 
leading coefficient 1 which has A as a root, and is clearly of degree <n? when 
dim U = n. Actually, it can be shown that the degree of m,4(x) does not exceed 
the dimension of © for any nonzero transformation A: Ὃ — VU. The proof, 
however, is not easy. 
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EXERCISES 


In Exercises 1 through 5 compute the value of a[A] + [8] for the given scalars a, B 
and matrices [A], [B]. 


l.a=2,8 = -1, 


1 0 --2 4 --Ἱ 2 
[A] = [3 1 --5}’ [8] =|}3 --5 1 
2 -2 3 0 4 --2 


2.ἃ = —3, B = 4, 


> [8] -] 3. 1 


6 2 -3 =) 22 ἢ 
[4] = > [8] = 
1 0 4 -2 0 -4 


6 2 -3 oe. κα Ὁ 
[1-Ξ-|0 4 1: [8]Ξ-] 0 -ἰ -Ἔ 
3 -1 3 —¥ 4 0 
5.α = 3,8 = —3, 
0  -22 6 2 3-4 1 
[4] Ξ-|] 2 -1 - 00]: [8] Ξ[ 0 6 -2 3 
—3 1 ἃ 4 4 2 0 2 


6. Let A denote the counterclockwise rotation of ®? about the origin through the 
angle 1/4, and let B denote the reflection across the origin. Find the matrix of 
A + B with respect to the standard basis e; = (1,0), e2 = (0, 1), and with respect 
to the basis οἱ = (1,1), οὐ = (—1, 1). 
7. Let A, B: ὦ — (G4 be defined by 
A(p(x)) = xp(x) — pl), βδί(ρ( )) = & — 1p). 


Find the matrix of 2A — B with respect to the standard bases in @3 and (a4, and 
with respect to the bases 


@i = {l,x —1,( — 1)7}, Bo = {1,x — 1,@ — 1)2, @ — 1)%}. 


8. Compute the dimension of the subspace of 3122 spanned by the matrices 


cat bot Gece 
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9, Letei,...,e, and fj,..., f,, be bases for U, and Ug, respectively, and for each pair 
of integers i,j with 1 <i<m,1<j <n, let E;;:01 — Ve be defined by 


0 if ἡ) εκ, 

f; if j= k. 
Prove that the E;; are a basis for £(U1, Va). 

10. Let A: S22 — Wee be the mapping defined by 


11 12 αι 12 
A = : 
Q21 Οἰ22 0 22 
Prove that A is linear, and find the matrix of A with respect to the standard basis 


in Wee. 
11. Repeat Exercise 10 for the mapping 4:9@22 — Ie3 defined by 


Q11 @12 αι ai2 0 
A -- - 
a21 a22 a21 α O 
12. What is the dimension of the vector space LQMWn1, in)? Of L(Mnn, Wg)? 
13. (a) Prove that the functions sin x, cos x, sin x cos x, sin? x, cos? x are linearly 
independent in C(— οὐ, ~), 
(Ὁ) Let U denote the subspace of C(— ©, ~) spanned by the functions in (a). Prove 


that D”, the mth power of the differentiation operator, maps VU into itself for all 7, 
and find the matrix of D? ~ 2D + 1 with respect to the given basis for VU. 


14. Let A: U — Ὃ be linear, with A ¥ O, and let k be the smallest positive integer such 
that A* is linearly dependent on J, A,..., A*—!. Prove that J, 4,..., A*-1 is a 
basis for the subspace of £(‘U, Ὃ) spanned by the powers of A. 

15. Find the minimum polynomial of the linear transformation D: Ὅς — ὦ. 


Ei;(e) = | 


2-8 MATRIX MULTIPLICATION 


Continuing in the spirit of the last section we now define a multiplication for 
matrices by rewriting the definition of the product of two linear transformations 
in matrix form. To this end let. 


B: V1 — Va, A: Ὁ. —- V3 
be given, let 


@B, = {e;,...,e,}, Bs = Πρὸ ΣΎ tars ῶς = {Z1,..-, Bm} 


be bases for U1, U2, U3, respectively, and let 


Ble;) = >> Brife, 
k=l 


A(f,) = > AikBi- 
i=l 
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Then we have 


AB(e;) 


A (> Pritt) = Σ) βμα(ὼ 
k=1 k=1 


.» Brij (Σ ἀμει) 
k=l 


= 


τὴ nr 
= > (> αμβιν Βὺ 
i=1 \k=1 

and the matrix of AB with respect to @;, ὦ is the m X r-matrix whose ith entry 
15 > k=1 ας βῃ]. But since 


[A: Be, Ba] = (aix), l<i<cm, 1<k<y, 


and 
[B: Bi, Be] = (Bxj)s 1 <k<a, Ι <j<r 


we 


the requirement that 
[AB: ὧι, 3] = [A: Be, 3118: B1, Be] 


leads to the following definition of matrix multiplication. 


Definition 2-8. The product (a;,)(8,;) of an m X n-matrix (a;,) and an 
n X r-matrix (6;;) is by definition the m X r-matrix 


(aix)(Bei) = (Σ cinB) (2-34) 


k=1 


It is important to notice that the product of two matrices is defined only when 
the number of columns in the first matrix is equal to the number of rows in the second; 
a restriction which is the matrix analog of the fact that the product of two linear 
transformations is defined only when the image of the first is contained in the 
domain of the second. When written in greater detail, Eq. (2-34) becomes 


O11 G12  αϊῃ βιι Bi2 τ Bir 

O21 O22 ᾽ Gen Boi Bo2 **: Bar 

Om1 Am2 °** Amn Bni Bn2 ag Bar 
011811 τ τ + ainBni τ @11Bir + τ΄ + GinBar 
91811 + τ + GQenBni 5 G2a1Bir + °°* + GanBar |, 
Om1611 + ns + AmnBni wo Om1PB ir + as + AmnPar 


and is easily remembered in terms of the kinesthetic relationship between the 
rows of the first matrix and the columns of the second. 
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EXAMPLE 1. If 
1 3 


} (6.3) Ξ [ --22 1’ 


2 -τΙῖ 0 
0 4 


1 2 --3 
then (a;;)(8;;) is defined, and we have 


i bee aety Geis μύξα νάψιοι 
(ak Bj) = 1-1 + 2-(—2) + (—3)-0 1.3 Ὁ 2:1 - (-3)4 


δ 


On the other hand, (6;;)(a:x) is not defined since the number of columns in (8x3) 
is not equal to the number of rows in (a;,). 


3 1 —1 2 
(aij) = ES , > (Bi) = ᾿ ἢ 
1. 4713 ...95]: tee ὦ 
(α;))(8.2) = | ᾿ ᾿ 7 = 3 Ν᾿ 
—1 2 31 --5 3 
(8:;)(ai3) = ἢ | ἢ = 5 ‘| 


and we see that the multiplication of square matrices is noncommutative. 


EXAMPLE 2. Let 


EXAMPLE 3. Let [A] be the matrix of a linear transformation A: Ὃ — VU with 
respect to a basis ὦ in Ὁ, and set [A]° = [J] where [/] is the appropriate identity 
matrix. Then the various powers [A]*, k a nonnegative integer, are all defined, 
and are simply the powers of A with respect to ®. (Why?) This in turn implies 
that the matrix of a polynomial 


p(A) = ayA* + ay_1A** + +--+ + aA + aol 
in A is 
Ρ(Α1) = αμ[47" + ακ. 1415 + +++ + α0{4] + afl]. 
Such expressions are called polynomials in [A], and are defined whenever [A] 
15 a square matrix. In particular, if 


ma(x) = x” — ay x"! — +++ — ayx — a 
is the minimum polynomial of A defined in Example 3 of the preceding section, 
then 
ma({A}) = [A]* — ax_s[A]"—* — --- — απ] — α([Π = [0], 
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and it follows that [A] is a root of m,4(x). For obvious reasons this polynomial 
is also called the minimum polynomial of the matrix [A]. 


Since Definition 2-8 is simply a coordinatized version of the multiplication of 
linear transformations, all of the results proved in Section 2-3 remain true when 
phrased in terms of matrices. This allows us to assert (without proof) that matrix 
multiplication is associative, and is distributive over addition, that is, 


[Case Be Vi) = Cae N(Be (150) (2-35) 


and 
(ase (Bx) + (Yes) = Corin)(Bxj) + (ak) (Ves), 
[(aik) + (Bix) (Ves) = (α:)( }} + (Biz)(%e3) 


whenever the sums and products appearing in these equations are defined. 
Similarly, the identity matrices introduced in Example 3 of Section 2-6 play the 
same role in matrix multiplication that the identity transformations play in operator 
multiplication. And finally, we can use these identity matrices to define right, 
left, and two-sided inverses for matrices by rewriting Eq. (2-21) and Definition 2-6 
in matrix terms. The details have been left to the reader. 


(2-36) 


EXERCISES 


1. Evaluate each of the following products. 


(a)|1 —3 2 6 1 
4 1 591 --2 3 
2. “=35 3 3 —4 


() } ὁ ¢ 090  -“! --Ὦ 
ὃ ὦ πὲ] |]πῚ 211 
0 ¢ ἐ zs -l1 ¢ 
4 4 
0 0 
ΩΣ 4 -1 a3 , @} ,{2 αὶ -1 3] 
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. Find all 2 Χ 2-matrices which commute with 


“ἢ 


. Find necessary and sufficient conditions for the matrices 


Q11 12 Q11 21 
and 
a21 a22 Q12 a22 


to commute. 


. Ann X n-matrix [A] is said to be invertible with inverse [A]—! if and only if 


[4114]. = [4]-"[4] = Π], 


where [J] is the n X n-identity matrix. 
(a) Show that if [A] has a right inverse [B] and a left inverse [C] then 


[8] = [C] = [41Γ}. 


oe 
011 


has no left inverse in 9132, but has infinitely many right inverses in S32. 


(b) Show that the matrix 


. Find the inverse of each of the following matrices. 


(a)il —1 (b) | 1 0 -1 (c) | 0 1 --3 
᾿ i 2 1 0 2 1 0 
1 0 1 1 --2 1 
. Show that the matrix 
2 1 - 
α 0 1 
β OO ea 


is invertible if and only if 8 + a?, and find its inverse when this condition is satisfied. 


. Find all values of a and β for which each of the following matrices is invertible, and 


compute their inverses. 


(a) ; " i ἠ ()f1 0 α 
β 2 a” β' 0-1 O 


. Compute [A]” when 


1 1 1 1 
(a) [4] -| | (b) [4] -| 
1 1 0 0 


10. 


11. 
12. 
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1 —1 0 1 a 1 
() [4 = (ὦ [4] = | () [4] = | 
—1 1 1 0 0 a 


. Find all 2 Χ 2-matrices 


such that 


ai 


An n X n-matrix (α;;) is said to be nilpotent if and only if there exists an integer 
k > 0 such that (@;;)* is the m X n-zero matrix. The smallest positive integer for 
which this is true is called the degree of nilpotence of (a;;). Show that each of the 
following matrices is nilpotent, and find their degree of nilpotence. 


ayfo 1-1 2 (o)f 1 1 3 ()f 1 -3 —4 
0 0 3 -2 5 2 6 -1 3 4 
0 0 0 4 —2 -1 -3 1-3 —4 


0 0 0 0 


Find all 2 Χ 2 nilpotent matrices with degree of nilpotence two. (See Exercise 10.) 


Determine which of the following matrices are roots of the polynomial p(x) = 
x3 — x74 x —-1. 


(a)|0 0 ()}0 1 0 
im as 
1 0 0 

«)f1 0 0 (@)f1 0 0 
| 0 1 0 0 1° 0 
t O44 1 Oo -1 


13. 


14. 


Let A: 922 — Mee be defined by 


7 i ᾿ ; : ix ie 
αὶ 22 0 - ΔΩ] a22 
Prove that A is linear, and find its matrix with respect to the standard basis in SW2o0. 


Repeat Exercise 13 for the mapping A:9e22 — S23 defined by 


4" " io “ ; 0. 4 
Q@21 a22 Q21 a22 2 1 1 
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15. Solve each of the following matrix equations for |X], given that 


2 1 —1 1 0 1 0 0 
0 3 2: 2] —1 1 0 0 


(a) 2[X] — [A][C] = [8]. (Ὁ) [C][X] — [A][B] = [0]. 

(Ὁ [X}?? = [4](18] — IC). 
16. Prove the associativity of matrix multiplication directly from Definition 2-8. 
17. Find 2 Χ 2-matrices [A], [8] such that 


[A][B] = [0], [48][4] [0], 


where [0] is the 2 X 2-zero matrix. 

18. Does [A][B] = [A][C] for n X n-matrices [A], [8], [C] necessarily imply that 
[B] = [C]? Why? 

19. Ann X n-matrix (@;;) is said to be a diagonal matrix if and only if a;; = 0 when- 
ever i + j. 
(a) Show that the product of diagonal matrices is diagonal. 
(Ὁ) Under what conditions is an n X n-diagonal matrix invertible? What is its 
inverse ? 
(c) Let 7: R! — Wan be defined by . 


eG see. "Ὁ 
T(a) =| 0 ea 0 
ὃ. ὃ 285m 


for all a in 613. Prove that T is one-to-one, linear, and that Τ(α) (β) = Τίαβ) = 
T(6)T(@) for all a, β. 
(d) Find the matrix of T with respect to the standard bases in R! and Man. 

20. Prove that the only n X n-matrices which commute with every matrix in Wan are 
the scalar matrices 


a 0 0 
0 a 0 
0 0 a 


2-9 OPERATOR EQUATIONS 


Much of the study of linear transformations is given over to devising methods 
for solving equations of the form 
Ax = y, , (2-37) 


where y is known, x unknown, and A a linear transformation from Ὃ: to Ve. 
Such equations are known under the generic name of operator equations, and will 
appear throughout this book in a variety of forms. In general, of course, the 
technique for solving a particular operator equation depends upon the operator 
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involved, and also upon the underlying vector spaces. Nevertheless there are a 
number of facts concerning such equations which can be proved without using 
anything other than the linearity of A, and we propose to get them on record here 
before going on to more specialized topics. 

A vector xo in U, is said to be a solution of (2-37) if A(xo) = y. The totality 
of such vectors is called the solution set of the equation. In the special case of a 
homogeneous equation 


Ax = 0 (2-38) 


whose right-hand side is zero, we know that this set is a subspace of Ὃ. It is called 
the solution space of the equation. One of the most important properties of 
operator equations is that the problem of solving a nonhomogeneous equation 
Ax = y,y ~ 0,canall but be reduced to that of solving its associated homogeneous 
equation Ax = 0. In fact, if x, is a fixed solution of Ax = y, and if x, is any 
solution whatever of Ax = 0, then x, + x, is also a solution of Ax = y, since 


A(Xp + Xn) = A(Xp) + A(Xn) 
y+ 0 
y. 


Moreover, every solution Χο of Ax = y can be written in this form for a suitable 
Χμ, since from 


A(X — Xp) = A(xo) — ACK») 
Tuy ey 
= 0 


it follows that x9 — Xp = Χλ 1s a Solution of Ax = 0, and hence that xg = Xp + Xa, 
as asserted. 

The solution x, appearing in this argument is frequently called a particular 
solution of Ax = y, and in these terms we can state the above result as follows: 


Theorem 2-9. Jf x, is a particular solution of Ax = y, then the solution 
set of this equation consists of all vectors of the form Xp + Xn, where Xx;, is 
an arbitrary solution of the associated homogeneous equation Ax = 0. 


Geometrically this theorem asserts that 
the solution set of a nonhomogeneous 
operator equation can be obtained from 
the solution space of its associated homo- 
geneous equation by translating that sub- 
space by a particular solution x, as shown 
in Fig. 2-9. Algebraically it gives us a 
prescription for solving Ax = y; ViZ., 
find all solutions of Ax = 0, one solution FIGURE 2-9 
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of Ax = y, and add. The reader will do well to keep both of these points of view 
in mind as we continue. 


EXAMPLE 1. Let A: C?(—o, 0) — C(—o, «) be the linear transformation 
D? — J introduced in Example 4, Section 2-4. Then the operator equation 


y in ©?(— οὐ, o), assumes the form 


d? 
aa =, (2-39) 


and its solution set consists of all functions in ©?(— οὐ, «) which satisfy this 
equation on the entire real line. In this case it is obvious that y = —1 is one such 
function. Thus, to complete the solution of (2-39) it suffices to find αἰ solutions 
of the homogeneous equation 


ae Y= Ὁ 


In Chapter 3 we will prove that the solution space of this equation has the functions 


e* and ο΄ as a basis, and hence as a corollary, that the solution set of (2—39) is 
the totality of functions in C?(— οὐ, o) of the form 


y = —1+ cye* + coe, 


where c, and C2 are arbitrary constants. 


Χο 


1X1 + AgX_=B8 


GX tagXo =0 
xy 


FIGURE 2.10 


EXAMPLE 2. Let A be a linear transformation from ®? to @!, let e; and eg be 
the standard basis vectors in ®?, and let A(e,) = αι, A(€2) = ae, αι and az 
real numbers. Then if x = x1e, + X2€q is any vector in ®”, 


A(x) = X1A(€1) + x2A(e2) 


1X1 + αοΧχ 2. 
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and the operator equation Ax = 0 is an abbreviated version of 
4X, + A2Xe = 0. (2-40) 


Since (2-40) is the equation of the line through the origin in R? with slope —a1/ag, 
the solution space of the equation Ax = 0 is just the set of points in ®? which 
comprise that line. In this case the solution set of the nonhomogeneous equation 
Ax = 8, β areal number, can be interpreted as a translation of the line described 
by (2-40), as shown in Fig. 2-10. 


It goes without saying that in particular instances the solution set of Ax = y 
may be empty, in which case the equation has no solutions. In fact, one of the 
major problems in the study of operator equations (or arbitrary equations for 
that matter) is to determine conditions under which the equation will have solu- 
tions. This is the so-called existence problem for operator equations, and theorems 
which establish such conditions are called existence theorems. 

Of equal, or even greater importance is the problem of ascertaining when Ax = y 
admits at most one solution for any given y in U,. This problem is known as the 
uniqueness problem for operator equations, and can always be answered by examin- 
ing the homogeneous equation Ax = 0 and using the following theorem. 


Theorem 2-10. An operator equation Ax = y will have a unique solution 
(provided it has any solutions at all) if and only if its associated homogeneous 
equation Ax = 0 has no nonzero solutions, i.e., if and only if N(A) = ὃ. 


The student should have no difficulty in convincing himself that this result is an 
immediate consequence of Theorem 2-9 and the description of the solution set 
of Ax = y given there. 

In the case where A admits an inverse of one of the various types discussed in 
Section 2-4, the equation Ax = y can be immediately solved. If, for instance, 
A is invertible, then from Ax = y we deduce that 


A~*(Ax) = Ay, 
or 
x = A7’y, 


and the solution (which in this case must be unique) has been described in terms 
of Α΄". Similarly, if B is either a right or left inverse for A we find that the solu- 
tion set of Ax = y is the set of all x in U, such that x = By. This technique for 
solving an operator equation is known as inverting the operator, and is used 
whenever an explicit formula for an inverse can be deduced from the definition 
of A. 


EXAMPLE 3. Systems of Linear Equations. As our final example we apply the above 
ideas to the study of systems of Jinear equations. Our motive for presenting this 
somewhat extended example is twofold. First, the theory of linear equations is 
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important in its own right, and the results we are about to obtain will be needed 
from time to time in our later work. Second, this material provides perhaps the 
easiest application of linear transformations to the solution of a nontrivial prob- 
lem, and should therefore help the student become familiar with such trans- 
formations. 

We begin by introducing some standard terminology. A system of m linear 


equations in the n unknowns x1, Xo,..., Xn 15 a set of equations of the form 
αὐιχι + ayexe Γ᾿ + ainxXn = Bi, 
αοιχΧ αἀοοχ εν AonXn = 
211 + 222 + + 2n~n Pas (2-41) 
Qm1X1 + AmeX2 τ τ᾽ ze AmnXn = Bms 


in which the α;; and 8; are real numbers. The α;; are called the coefficients of the 
system, and have been so indexed that the first subscript on any coefficient indi- 
cates the equation in which it appears, and the second the unknown with which 
it is associated. Such a system is said to be homogeneous if all of the 8; are zero; 
nonhomogeneous otherwise. Finally, a solution of (2-41) is an n-tuple of real 
numbers (61, Co,..., Cn) With the property that when c, 15 substituted for x,, 
Co for Χο, etc., each of the equations in the system becomes an identity. A system 
without solutions is said to be incompatible. 


Let | 
011 412 ‘*'* Qin 
[A] =  [΄αϑι @22 *** Gan 
Q2m1 ἀρῶ “** Amn 


be the m X n-matrix formed from the coefficients of (2-41), and let A: R” — &” 
be the linear transformation defined by this matrix relative to the standard bases. 
Then if x denotes the vector (x1,..., Xn) in ®”, and y the vector (81,..., Bm) 
in 67), (2-41) can be rewritten in operator form as 


Ax = γ. (2-42) 


Conversely, if A is an arbitrary linear transformation from &” to ®”, and if [A] 
is the matrix of A with respect to the standard bases in these spaces, Eq. (2-42) 
is equivalent to a system of m linear equations in nm unknowns for each fixed y 
in R™”. We now propose to use these observations to establish several important 
facts concerning solutions of systems of linear equations. 

In the first place, we know that (2-42) will have solutions if and only if the 
vector y = (61,...,8m) belongs to the image of the linear transformation A. 
Furthermore, if 


ΨΊΞ (α 11: 215 +++ 5 Am1)s con ye Sn = (ain; Cons. ἐν ὁ Oink) 
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denote the vectors in ®” formed from the columns of (2-41) (or, equivalently, 
from the columns of the matrix [A]), then 


AX = X1¥1 + X2¥2 ΠΤ XnYn 


for each x = (X1,..., Xn) in Θ΄. Thus Ax is a linear combination of y1,..., Yn, 
and it follows that these vectors span the image of A. This, combined with the 
observation made a moment ago, yields our first existence theorem. 


Theorem 2-11. The system of linear equations (2-41) has a solution if and 
only if the vector y = (B1,...; Bm) in &” is linearly dependent on the 
vectors Y1,... Yn formed from the columns of the system. 


To answer the uniqueness problem for (2-41) we pass to the associated homoge- 
neous system Ax = 0, and apply Theorem 2-10. We again use the fact that if 
ς = (c1,..., Cn) iS any vector in &”, then 


Ac = C1¥1 + °°° + CrYn. 
Hence ς will be a solution of the homogeneous equation Ax = 0 if and only if 


CiY¥i tots + CnYn = O. 


Thus Ax = 0 has a nontrivial solution (i.e., a solution in which at least one of the 
c; τέ 0) if and only if the vectors y,,..., Yn are linearly dependent in ®”, and we 
have 


Theorem 2-12. The system of linear equations (2-41) has a unique solution 
(provided it has any solutions at all) if and only if the vectors formed from 
the columns of the system are linearly independent in Q". 


Finally, since y,,..., Yn are always linearly dependent if n > γι, this result 
also yields 


Corollary 2-1. A homogeneous system of linear equations has nontrivial 
solutions whenever the number of unknowns exceeds the number of equations. 


2 
the general theory of 


linear differential equations 


3-1 LINEAR DIFFERENTIAL OPERATORS 


We have already had occasion to remark that the operator D which maps a 
differentiable function onto its derivative is a linear transformation (see Sec- 
tion 2-1). The same is true of polynomials in D, and of even more complicated 
expressions such as xD” + D+ x. Linear transformations of this sort which 
involve D and its powers are called linear differential operators. The study of such 
operators leads naturally to the theory of linear differential equations, the subject 
matter of this chapter and the chapters which follow. 

To give a precise meaning to the term “linear differential operator,” Jet 1 be 
an arbitrary interval of the real line, and for each non-negative integer n, let Θ᾽) 
denote .the vector space of all real-valued functions which have a continuous πίῃ 
derivative everywhere in J. [Recall that the vectors in Θ᾽ (71) are real-valued func- 
tions whose first n derivatives exist and are continuous throughout 7, and that 
vector addition and scalar multiplication in this space are defined by the equations 


(f + 9)0) = f(x) + g@), = (ef) = af), 


for all xin 1. By agreement, 6) = C(/).] 
In these terms we now state 


Definition 3-1. A linear transformation L: C"(J) — Θ(7) is said to be a 
linear differential operator of order n on the interval I if it can be expressed 
in the form 


L = a,(x)D" + ἀμ. τ)" + +++ + axQ)D + a(x), G-1) 


where the coefficients ao(x), ...,@n,(x) are continuous everywhere in J, 
and a,(x) is not identically zero on J. In addition, the transformation 
which maps every function in C”(/) onto the zero function 15 also con- 
sidered to be a linear differential operator. It, however, is not assigned an 
order. 

| 86 
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Thus the image of a function f in C"(/) under the linear differential operator 
described above is the function in C(/) defined by the identity 


Lf(x) = a(x) & fx) +--+ aE 700 + wO@, G2) 
or, more simply, by 


Ly = an(x)y + +++ + απο)» + ao(xdy, (3-3) 


where y’,..., y™ are the first n derivatives of the function y = f(x). Strictly 
speaking, the left-hand side of (3-2) is the value of Lfat the point x, and a scrupu- 
lous regard for accuracy would require that it be written (L(f))(x). For obvious 
reasons the extra parentheses are almost always omitted. Moreover, we shall 
occasionally refer to Lf(x) as “the linear transformation L applied to the function 
f(x),” thereby following the familiar custom of confusing a function with its 
value at a point. This, of course, is just a linguistic convenience, and once under- 
stood as such causes no difficulty. 


EXAMPLE 1. The nth derivative operator, D”, is the simplest example of a linear 
differential operator of order n on an arbitrary interval J. When ἡ = 0, 29 is 
just the identity transformation, and, in general, D” can be viewed as the nth 
power of the linear transformation D (see Section 2-3). 


EXAMPLE 2. Any polynomial in D of degree n, with real coefficients, is a linear 
differential operator of order n on every interval of the real line. 


EXAMPLE 3. A linear differential operator of order zero on J has the form 
L = a(x), (3-4) 


where dao(x) is continuous and not identically zero on J. Thus if fis any function 


Lf (x) = ao(x)f@), 


which, of course, is just the product of the functions ag and f. Occasionally one 
finds (3--4) written in the form ao(x)D° to emphasize the fact that ao(x) is being 
viewed as an operator and not as a function in C(/).* 


EXAMPLE 4. The linear differential operator 
xD? + 3V/xD— 1 


* Note that the expression ao(x) f(x) actually admits three different interpretations. 
It can be viewed as the product of the functions ao(x) and f(x), or as the value of the 
operator ao(x) applied to the function f(x), or as the product of the operators ao(x) and 
f(x). The particular interpretation chosen, however, is usually a matter of indifference. 
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is of order 2 in [0, oo) or any of its subintervals.* By way of contrast 


(x + |x|)D? — Vx + δ In(x + 1) 


is of order 2 on (—1, 1), but of order 1 on the subinterval (—1, 0] since x + |x| 
vanishes identically there. Thus the order of a linear differential operator may 
depend upon the interval in which it is being considered, as well as on the algebraic 
form of the operator itself. 


A linear differential operator is, by definition, a linear transformation, and 
hence, under suitable hypotheses, it makes sense to talk about the product of two 
such operators. Such products are again linear differential operators although it 
is impossible to say very much about their order or domain of definition (see 
Exercise 7). We remind the reader that the usual precautions arising from the 
noncommutativity of operator multiplication must also be observed in this setting. 
For instance, a product such as (xD + 2)(2xD + 1) cannot be computed by 
multiplying the expressions xD + 2 and 2xD + 1 according to the usual rules 
of algebra. Indeed, if it could, we would have (xD + 2)(2xD + 1) = 2x?D? + 
5xD + 2, when, in fact, the correct answer is 2x*D? + 7xD + 2, as can be 
seen from the following computation: 


(xD + 2)2xD + ly = (xD + 2)γώχγ' + y) 
xD(2xy' + y) + 2(2xy’ + y) 
x(2xy"’ + 3y’) + 4xy’ + 2y 


= 2x?y’ + Txy’ 4+ 2». 


However, in the special case of operators with constant coefficients products 
can be computed as though the operators were ordinary polynomials in D (see 
Section 2-3, and Exercise 12 below). As we shall see, this fact will ultimately 
enable us to solve al] linear differential equations with constant coefficients. 


EXERCISES 
1. Evaluate each of the following expressions. 
(a) (D? + D)e?* (b) (3D? + 2D + 2)sinx 
(c) («D — x)(2In x) (d) ὦ + 1)(D — x)(e* + cos x) — 


2. Repeat Exercise 1 for each of the following expressions. 
(a) (aD + bD+ ce’, a,b,c, k constants 
(b) αὖ — 2xD + 4)x*, ka constant 


* The intervals [a, 5) and (a, b] are defined, respectively, by the inequalitiesa < x « b, 
a <x <b. The first is said to be open on the right and closed on the left, the second 
closed on the right and open on the left. 


10. 


11. 


12. 
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1 
(c) (ἀχ 2 + 4xD + 4x° + 1)——sin x 
/x 


. Find constants a, ὁ, c such that a + 6+ c = 1, and 


[a — x?)D? — 2xD + 6](ax? + bx + c) = 0. 


. Write each of the following linear differential operators in the standard form 


Qn(x)D" + +++ + ai(x)D + ao). 
(a) (D? + 1)(D — 1) (b) xD(D — x) 
(c) (xD? + D)? (ἃ δὲ. Ὁ — 1)D 
(e) D(De* + 1) + e* 


. Show that D(xD) ¥ (xD)D. 
. (a) Prove that a linear differential operator of order n is a linear transformation 


from 6 (7) to C(Z). 
(b) Is this linear transformation one-to-one when n > 0? Why? 


. (a) Compute the product of the linear differential operators ai(x)D + 1 and 


b1(x)D + 1 when 


0, x <0, x"/2, x <0, 
ai(x) = ; bi(x) = 
x /2,. ἀ Σὺ; 0, x > 0, 


and thus deduce that the order of the product of two such operators need not be 
the sum of the orders of the factors. 


(b) Give an example to show that the product of two linear differential operators 
on an interval 7 need not be defined on the same interval. 


. Prove that D™(a(x)D") is a linear differential operator of order m - πὶ by expressing 


this product in standard form as a “‘polynomial” in D. [Assume the existence and 
continuity of all the necessary derivatives of a(x).] 


. Find the sum Z,; + Loe of each of the following pairs of linear differential operators. 


(a) Ly = 2xD + 3, Le = xD-—-1 

(b) Ly 6:02 + D, Lo e-*D* — D 

(Cc) 11 = xD+1, Lz = Dx 

Prove that the sum of two linear differential operators defined on an interval J is 


the linear differential operator on J obtained by adding the corresponding coeffi- 
cients in the standard “polynomial” representation (3-1) of the given operators. 


Let 


Ι 
I 


Li = δ) αἰ)" and La = Σ᾽ δι) δ" 
=0 =0 


be linear differential operators on an interval J. Prove that 1.1 = Lg if and only if 
m = ἡ, and a,(x) = 6b, (x) for all k. 
(a) Prove that 

(aD”)(bD") = (bD")(aD") = αὐ ἢ" 


whenever a and ὦ are constants. 
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13. 


14. 


Ἐ15: 


16. 


17. 


Ἐ18. 


*19. 
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(b) Use (a) and the general distributivity formula for linear transformations that 
was established in Section 2-3 to prove that the multiplication of constant coeffi- 
cient linear differential operators is commutative. Deduce from this that the product 
of two such operators can be obtained by treating them as ordinary polynomials 
in D and using the usual rules of elementary algebra. 

Factor each of the following linear differential operators into a product of irreducible 
factors of lower order. 


(a) D? —-3D+ 2 (ὁ) 4D* + 4D? — 7D2 + D — 2 
(Ὁ) 2D? + 5D + 2 (Ὁ D* —1 

(c) 4D? ++ 4D+4+1 (g) D* + 1 

(d) D? — 3D? + 4 (h) D® — 1 

Prove that 


(a) ΘΟ) ΟῚ] = fF" COg) + 2.Οὐε' ΟἹ + fe’), 

(0) δ᾽) ΟἹ) = fC) + 3 de’) + 3. Οὐκ" ΟἹ + 70) ε“0.. 

Can you make a conjecture as to the form οὗ D"[f(x)g(x)]? (‘No” is not an ac- 
ceptable answer.) 

Use mathematical induction to prove Leibnitz’s rule: 


DL] = ΣΣ (7) (D"*4@))(De@)), 
k=0 


where m_ π᾿ nt — 1) @ HRD), 
(;) = aie — mI 


k'(n k! 
Use the result of the preceding exercise to express each of the following linear 
differential operators in the form a,(x)D" + τ.’ + a1i(x)D + ao(x). 
(a) D®(xD) 
(Ὁ) D“(xD) 
(c) D®°(xD? + e*) 
Prove that for any pair of non-negative integers k and m, 


Dx* = jm! () x” m<k, 
0, γι Ὁ k. 
(a) Prove that 
(x™D™)x*" = kk — 1)... (kK — m+ 1)x" 
for any real number k. 
(b) Prove that 


(a2x* Ὁ" + ayxD + ao)x" = [aok(k — 1) + ark + ao)x* 


for any real number k (ao, a1, a2 constants). 

(c) Prove that (xD)(x?D?) = (x?D)(xD). 

A linear differential operator is sometimes said to be equidimensional or an Euler 
operator if it can be written in the form a,x"D” + +--+ a1xD + ao, where 
ag....-,@, are constants. 
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(a) Compute the value of Lx, k an arbitrary real number, when L is equidimensional. 
(Ὁ) Prove that (x”™D™")(x"D") = (x*D")(x"D”) for any pair of non-negative inte- 
gers m, n, and hence deduce that the multiplication of equidimensional operators is 
commutative. [Hint: Use the results of Exercises 15 and 17.] 


3-2 LINEAR DIFFERENTIAL EQUATIONS 


An nth-order linear differential equation on an interval 7 is, by definition, an 
operator equation of the form 
Ly = h(x), (3-5) 


in which ἢ is continuous on 7, and L is an nth-order linear differential operator 
defined on J. Such an equation is said to be homogeneous if h 15 identically zero 
on I, nonhomogeneous otherwise, and normal whenever the leading coefficient 
a,(x) of the operator L does not vanish anywhere on /. Finally, a function y(x) 
is said to be a solution of (3-5) if and only if y(x) belongs to C”(/) and satisfies the 
equation identically on J. | 

Thus an nth order linear differential equation is simply an equation of the 
form 


an) SZ +--+ + are) ® + aglxdy = 10), (3-6) 


whose coefficients ao(x), ... , n(x) and right-hand side A(x) are continuous on an 
interval J in which a,(x) is not identically zero. Typical examples are provided 
by the equations 


d’y 
τα) =: 


which is homogeneous, normal, and of order 2 on (— oo, o) or any of its sub- 
intervals, and 


which is nonhomogeneous, normal, and of order 3 on (0, οὐ and (— οὐ, 0), but 
is non-normal on any interval containing the origin. 

The primary objective in the study of linear differential equations is to find all 
solutions of any given equation on an interval J. As might be expected, this is a 
difficult problem, and a complete answer is known only for certain special types 
of equations. However, there exists a considerable body of knowledge concerning 
the general behavior of solutions of linear differential equations, and in this 
respect the theory of such equations stands in refreshing contrast to that of non- 
linear equations. This, of course, is due to the fact that the techniques of linear 
algebra can be used in this context, and the present chapter constitutes our first 
substantial application of these ideas to the study of a problem in analysis. 
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As an illustration of the way in which linear algebra intervenes in the study of 
differential equations, let 
Ly = 0 (3-7) 


be a normal, homogeneous linear differential equation of order n on an interval J 
of the x-axis. In this case the solution set of the equation is none other than the 
null space of the linear transformation L, and hence is a subspace of C"(/). Out 
of deference to the problem at hand this subspace is called the solution space of 
the equation, and the task of solving (3-7) has been reduced to that of finding 
a basis for its solution space, provided, of course, the solution space is finite 
dimensional. It is; and later in this chapter we shall in fact prove that the solution 
space of any normal nth order homogeneous linear differential equation is an n-dimen- 
sional subspace of C"(1). Thus if L is normal, and if y,(x), .. . , Yn(x) are n linearly 
independent solutions of (3-7), then every solution of that equation must be of the 
form 


Y(x) = C1yi(X) Ἔ τ" + Cnn) (3-8) 


for suitable real numbers c;. Conversely, every function of this type is certainly 
a solution of (3-7) whenever y;(x),..., ¥n(x) are, and for this reason (3-8), 
with the ἐς arbitrary, is called the general solution of (3-7). Finally, any function 
obtained from the general solution by assigning definite values to the c, is called 
a particular solution. We leave the reader to reflect upon the merits and short- 
comings of this somewhat unfortunate choice of terminology. 

By a familiar line of reasoning, these results are also pertinent to the study of 
nonhomogeneous equations. Indeed, in Section 2-9 we saw that if γρ(χ) is any 
solution of the nonhomogeneous equation 


Ly = h(x) (3-9) 


and if y,(x) is the general solution of the associated homogeneous equation Ly = 0, 
then the expression y,(x) + yn(x) is the general solution of (3-9). In other words, 
the solution set of a nonhomogeneous linear differential equation can be found by 
adding all solutions of the associated homogeneous equation to any particular solu- 
tion of the given equation. Needless to say, this argument effectively reduces the 
problem of solving a nonhomogeneous equation to that of finding the general 
solution of its associated homogeneous equation. And in the next chapter we 
shall complete this reduction by giving a method whereby a particular solution 
Yp(x) of (3-9) can always be found once the general solution of the associated 
homogeneous equation is known. 


EXAMPLE 1. The functions sin x and cos x are easily seen to be solutions of the 


second-order equation 
y’+y =0 (3-10) 


on the interval (—«, «). Moreover, these functions are linearly independent 
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in Θ΄ (-- 00, oo), since 
c,sinx + c.cosx = 0 


for all x implies, by setting x = 2/2 and x = 0, that c, = Oand cz = 0. Thus 
the general solution of (3-10) is 


y = c,sinx + c2C0S x, (3-11) 


where c, and Cg are arbitrary constants. The reader should note that without a 
theorem such as the one cited above there would be no guarantee whatever that 
(3-11) includes every solution of the given equation. 


EXAMPLE 2. The function y,(x) = x 1s obviously a solution of the nonhomoge- 
neous equation 


yo ry=x (3-12) 


on (—oo, #). Hence, since 61 sin x + c2cos x 15 the general solution of the 
associated homogeneous equation γ΄ + y = 0, the general solution of (3-12) is 


y=x+c,sinx + cgcosx. 


Before leaving this section it may be instructive to compare the solution set 
of a nonlinear differential equation with that of a linear equation. To this end we 
consider 

ψ' — 3y?2/> = 0, (3-13) 


which, as is easily seen, has the family of cubic curves 
y= (+0) (3-14) 


as its “general” solution on the interval (— οο, οὐ). (See Fig. 3-1.) In particular, 
the functions x* and (x + 1)? are solutions of (3-13). But their sum is not, and 
hence the solution set of this equation is not a subspace of C!(— oo, «), even 
though the equation appears to be homogeneous. Moreover, all of the various 
solutions obtained from (3-14) by assigning different values to c are linearly 
independent in @!(— οὐ, 00), and we conclude that a first-order nonlinear differential 
equation can actually have infinitely many linearly independent solutions. Finally, 
(3-13) also admits an infinite number of solutions which cannot be obtained from 
(x + c)° by specializing the constant c. All of these somewhat peculiar solutions 
have the property that they are zero along an interval of the x-axis and are of the 
following three forms: 


_ ὯΝ ay’, x <a, _ ἢ x <b, 
¥ = jo, x>a 7 ᾷΡ,Γ[α -- δ)λβ,,), x>B5, 
(x — a)’, x <a, 

y = 40, a<x<b, 

(x — δ), x>b 
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FIGURE 3-1 


Thus, to use the term “general solution” in reference to (3-14) is in this case a 
genuine misnomer. In short, every single one of the properties enjoyed by the 
solution set of a linear differential equation fails to hold here—a fact which, if it 
does nothing else, should convince the student that linear differential equations 
are rather more pleasant to encounter than nonlinear equations. 


EXERCISES 


1. Determine the order of each of the following linear differential equations on the 
indicated intervals. 


(a) xy’ — Qx + Dy = 3, or (—%,~0) (Ὁ) (D+ 1)?y = 0, οη (0, 1) 
(c) (x + |x)y’” + (sin xy’ = 2e7, on (—1, 1); on (0, ~) 
(d) Vx »" — 2y' + (sin x)y = Inx, on (1, ~) 


(ec) α +1 + |x + 10)» + & + [x)y’ + 2ν = 0, on (—%, ©); on (0, ~); 
on (—1, 0) 
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2. In each of the following show that the given function is a solution of the associated 
linear differential equation, and find the interval (or intervals) in which this is the 
case. 

(a) xy’ + γ' = 0; In (1/x) 

(b) 4x2y" + 4xy’ + (4x? — Ly = 0; V2/(xx) sin x 
(c) ( — x2)y" — 2xy’ + ὅν = 0; 3x? -- 1 

(d) x2y” — xy’ + y = 1; 1+ 2xInx 

(ὁ) (1 — x?)y” — 2xy’ + 2y = 2; xtanh—! x 

3. (a) Show that e** cos bx and e** sin bx are linearly independent solutions of the 

equation 
(D2 — 2aD + a* + δῶν = 0, ὃ #0, 
on (—«, ), 
(b) What is the general solution of this equation? 
(c) Find the particular solution of the equation in (a) which satisfies the “initial” 
conditions y(0) = ὁ, y’(0) = —a. 
4. (a) Show that e** and xe*” are linearly independent solutions of the equation 
(D — a)*y = 
(Ὁ) Find the particular solution of this equation which satisfies the “initial” condi- 
tions y(0) = 1, y’(0) = 2. 
5. (a) Verify that sin? x and sin x — ᾧ sin 3x are solutions of 
γ' + (tanx — 2cotx)y’ = 0 
on any interval where tan x and cot x are both defined. Are these solutions linearly 
independent ? 
(b) Find the general solution of this equation. 


6. Show that $x? and $(x?/2 + 1)? are solutions of the nonlinear differential equation 
(dy/dx)? — xy = 0o0n (0, ©). Is the sum of these functions a solution? 

7. In each of the following show that the given functions span the solution space of 
the associated differential equation. Find a basis for the solution space in each case, 
and use it to obtain the general solution of the equation in question. 


(a) y’ — y = 0; sinh x, 2e “, —coshx, on(—®, 0) 

(b) χἕγ'" — 5xy’ + 9y = 0; 2x? In χ, x’, x°(2 Inx — 1), on(O, ~) 

(c) γ΄ + 4y = 0; sin 2x, —2 cos 2x, —cos (2x — 3), on(—%, ©) 
x, 1+x 


(ὦ (1 — x”)y” — 2χγ' + 2y = 0; 3x, = In ~1,~> on(—1,1) 
2 1—x 2 
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Let Ρ 
αι(χ) F + a(x)y = h(x) (3-15) 


be a normal first-order linear differential equation defined on an interval J of the 
x-axis. Then, as we know, the general solution of this equation can be expressed 
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in the form 
Y = Yp(x) + yr(X), (3-16) 


where y,(x) is any “‘particular” solution, and y,;(x) is the general solution of the 
homogeneous equation 


a(x) 2 + a(x) = 0. (3-17) 


Since a;(x) * 0 everywhere in J, (3-17) may be rewritten 


1 dy Ao(x) | 


ydx” 6 a(x) 


nin - [2 


ly] = oS lao(@)/a1 (2) 1d 


Hence, by the theorem cited in the preceding section, the general solution of (3-17) 
is 


y £0, 


and integrated to yield 


or 


= d 
y= ce Stao(x)/ay(z)) = 


where c is an arbitrary constant. 
To obtain a particular solution of (3-15), we rewrite the equation as 


ao(x) , h(x) 
ΞΞΞ 3 3-18 
ee? ae oe 
and multiply by e/!%0/%@14" to obtain 
dy αρ(χ) ) Stao(z/ayayide _ A(X) 61 lao(2)/ay (x) Ida 3-19 
( Kaa)’ ) ° ΟΝ ee 


But 


ad Stag(2)/ay(x)\dzy _ GO, f ag(x)/a,(x)]dx 
dx (ye ) τ e ΣῈ Ξ 9 


a(x)” 
and so (3-19) may be replaced by the equivalent equation 


d Sfag(x)/ay(x)]dx rum A(x) es lao(e)/ay(2)]\dz 
(ye )= 
d. a ay(x) © 


Thus 


_ _Stap(x)/a(x) dz | @ h(x) pflaotzylar(2ide 
y=e x, 
αι)“ 
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and it follows from (3-16) that the general solution of (3-15) is 


Ν W(X) _ftag¢z)/a;(x) dx | —Jlao(x)/a;(x)]dz a 
y=[e+ | He) axle , 620) 


c an arbitrary constant. 

Considering the simplicity of the technique underlying this result, it is not 
recommended that the student commit (3-20) to memory. Instead he should re- 
member the general method, which can be described as follows: To find the general 
solution of a normal first-order linear differential equation, rewrite the equation in 
the form 


ἄν, αὐ)... AG), 
dx a;(x) a;(x) 


J lao(x)/a(x)]dz 


multiply by e , and integrate. 


EXAMPLE 1. Find the general solution of 


Thus 


and it follows that 
ΤΩ —z? Ι —z? 
y= (Gt ele Ξ 5 1 ce ; 
EXAMPLE 2. Solve the equation 
dy - 
x +y=x. (3-21) 


Since the leading coefficient of this equation vanishes when x = 0, the above 
method applies only on the intervals (0, 0) and (—oo,0). There, however, 
(3-21) may be rewritten 


and solved by introducing the “integrating factor” 


efdziz _ pinizl _ |x]. 
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Multiplying (3-22) by |x| and integrating, we obtain 


y|x| = [να το 


- a + ὦ x > 0, 
δ 2 
x 
me ae ok x <0 
Thus 
C..-% 
pg eee 
ΩΝ ὅδ. ἋΣ 
Σ᾽ x <Q, 
and since c is arbitrary we have 
δ 
lea Ba 


We call the reader’s attention to the fact that x/2 is the only solution of the given 
equation defined on the entire real line. Nevertheless it is common practice to 
call c/x + x/2 the “general solution” of (3-21) without specifying the interval 
in question—a practice which is admittedly convenient, but potentially misleading. 


EXAMPLE 3. We now use the above technique to solve the nonlinear equation 
dy ἢ 
a(x) 7. + aolx)y = Λα)», (3-23) 


where n is an arbitrary real number. This equation is known as Bernoulli’s 
equation, and here, as always, we assume that a(x), a,(x), and A(x) are con- 
tinuous on an interval J, and that a,(x) τέ 0 οἡ 1. 

Dismissing the cases n = 0 and n = 1 which have been treated above, we 


rewrite (3-23) as 


ax(ay” & + ag(xy™ = hd), (3-24) 


and make the change of variable u = y'~”. Then 


du = ἂν 
dx = (1 "" n)y dx 
and (3-24) becomes 
a,(x) du 
1 —n dx 


+ ao(x)u = A(x), 


which is a normal first-order equation on the interval 7. We now solve this equa- 
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tion for u, and then express the general solution of (3-23) as y = εἴπ Finally, 
if n > 0, we add the solution y = 0 “suppressed” in passing from (3-23) to 


(3-24), and we are done. 
Thus, to solve 


dy _ 2 
Ay +y = (yy, 
we first rewrite the equation as 


_9 dy ΒΕ 
2 ay ι 2 
y amt? x"; 


and then make the change of variable u = γ }. This gives 


from which we obtain 


Hence 
u=2+2x4+ x? + ce’, 


and the solutions of (3-25) are 


y = (24+ 2x + x? + ce*)', +c arbitrary, 


and y = 0. 

EXERCISES 
Find the general solution of each of the following equations. 

1. xy’ + 2y = 0 2.0 — x*)y’ —y = 0 

3. (sin x)y’ + (cos x)y = 0 4. 3y’ + ky = 0, kaconstant 
5, 2) γ +3y =e 6. 3χγ' —y = Inx +1 

7. Lo + Ri = Ε, L,R, Econstants, L, R ~ 0 


8. (3x? + 1)y’ — 2xy = 6x 
9. (x? +1)’-(a -- x)*y = xe 
10. (x? + 1)y’ + xy = 1 — 2) +1 


11. xsin x > + (sinx + xcosx)y = xe 


dy y 
12. x — 4+ —————— = 14+v02x4+1 
dx 2x +1 


(3-25) 
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OW ie οὖ Pe rage 
Dg area, = 1 — x? )e 


14. sin x cos x Α +y= tan” x 15. a + sin x)? + (2cos x)y = tanx 
2. 2 
16. 2 ae ee _ 2 15: 3 --Σ FE gO ΟΣ ον 
6. 2( χὺν a x")y = xye 17. y a aaa 
18. yy’ + xy? —x =0 
19. (x7 + νυν = χοῦ 4+ — x) Vy 
20. (x7 + x + τ)νν' + (2x + 1)» = 2x - 1 
x(x + Inx sin 2x 
21. xy’ + nx = Ξε ἘΞ 22. yty=Aat+ cos χ)γ Ὁ 


8 
*23. (x -- 1)γ' — 2y = ν (3 -- Dy 24. γ' = @ + 1) Inx — xGx + 4)» 


(x3 + 2x2 — 1)y? 
25. ΟΥὟ = (xy)"@ + 1) 
26. Find the particular solution of the equation xy’ — (sin x)y = 0 on the interval 
(0, ©) which passes through the point (1, —1). [Hint: Show that the general solution 
of this equation on (0, ©) may be written in the form y = celi Gin Nita y > 0] 
27. (a) Find the solution curve of the equation 


which passes through the point (2, —3). [Hint: Find the general solution and show 
that it can be written in the form 


(b) What is the ordinate of the point on the solution curve found in (a) corresponding 
to the point x = 1? (Consult a table of values for (1,ν. 2π) [2 e~/? dt.) Find the 
slope of the solution curve at this point. 


Riccati’s equation. Any first-order differential equation of the form 


Εν + ao(x)y” + ai(x)y + ao(x) = 0, (3-26) 


‘ in which ao(x), a1(x), a2(x) are continuous on an interval J and a2(x) # 0 on J, is called 
a Riccati equation. A number of elementary facts concerning the solutions of such equa- 
tions are given in the exercises which follow. 

28. Let yi(x) be a particular solution of (3-26). Make the change of variable y = 
γι + 1/z to reduce (3-26) to a first-order /inear equation in z, and hence deduce 
that the general solution of a Riccati equation can be found as soon as a particular 
solution is known. 

Use the technique suggested in the preceding exercise to find the general solution of each 

of the following Riccati equations. 

29. γ' — xy? + (2x — τὴν = x — 1; particular solution y = 1 
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30. y’ + xy? — 2x2y + x? = x + 1; particular solution y = x — 1 
31. 2y’ — (y/x)? — 1 = 0; particular solution y = x 
32. γ' + y? — (1 + 2e*)y + 625: = 0; particular solution y = e* 
; 1 7 : . 
33. y’ — (sin? x)y? + —————— y + cos? x = 0; particular solution y = ee = 
sin x cos x sin x 


34. (a) Let yi(x) and ye(x) be two particular solutions of Eq. (3-26). Show that the 
general solution of the equation is 


y= Jt = cel tue uae 
Y= Y2 
c an arbitrary constant. [Hint: Consider the expression 
yy »' as 
Became y— y2 
(b) Let yi(x), y2(x), and y3(x) be distinct particular solutions of Eq. (3-26). Use the 
result established in (a) to prove that the general solution of the equation is 


(y — yids — »») 
(y — y2)(v3 — y1) 


3 


c an arbitrary constant. 


35. (a) Show that a constant coefficient Riccati equation 
ad 

< tay? + by +e =0 
Ix 


has a solution of the form y = m, ma constant, if and only if mis a root of the 


quadratic equation 
am? +- bm +c = 0. 


(b) Use this result, together with Exercise 28 or Exercise 34(a), as appropriate, to 
find the general solution of each of the following Riccati equations. 


ὦ γ +y?+3y+2=0 (ii) γ΄ + 45 --9-Ξ.0 
(iii) y’ + y? — 2y4+1=0 (iv) ὅν’ + 6y? + yy —1=0 
36. (a) Prove that the change of variable v = γ΄)» reduces the second-order homoge- 
neous linear differential equation 
»" + ai@)y’ + ao)y = 0 (3-27) 
to the Riccati equation 
υ' + v? + ai(x)v + ao(x) = 0, (3-28) 


and hence deduce that the problem of solving (3-27) is equivalent to that of solving 
the simultaneous pair of first-order equations 


dy dv 


dx = DY, Ax. υ ai(x)v ao(x). (3 29) 


[Equation (3-28) is called the Riccati equation associated with (3-27).] 
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(Ὁ) What conditions ought one impose on (3-29) to correspond to the conditions 
yO) = yo, YO) = γι on G-27)? 
(c) Prove that every Riccati equation (3-26) in which a2(x) ~ 0 can be converted 
to a second-order homogeneous linear differential equation by making the change of 
variable y = υ᾽ (ας). 

37. Find the Riccati equation associated with γ΄ — »y = 0. Solve this equation, and 
hence find the general solution of γ΄ — y = 0. 

38. Prove that whenever m, and mz are distinct real roots of the quadratic equation 


am? +- bm + c = 0, a,b, c constants, 


then e”17 and e”2” are linearly independent solutions in C(— ©, ©) of the second- 
order homogeneous linear differential equation 


ay’ + by’ +c = 0. 


(See Exercises 35(a) and 36(a).) 

39. Use the result of the preceding exercise to find the general solution of each of the 
following second-order linear differential equations. 
(a) »" — Sy’ ἰόν = 0 (Ὁ) 2ν΄ + y’ —3 = 0 
(c) (Ὁ + 1)(D — 2)y = 0 (d) (12D? — D — 20)y = 0 
( 2D? — 3» = 0 

40. Prove that e”* and xe” are linearly independent solutions in C(—~, ©) of the 
second-order homogeneous linear differential equation 


γ' — 2my’ + my = 0, 


ma constant. 
41. Use the result of the preceding exercise to find the general solution of each of the 
following second-order linear differential equations. 
(a) γ΄’ + 2y'+1=0 (Ὁ) ἀν! — 12y’ + 9y = 0 
(c) ὦ — ὃξν = 0 (4) 36D? — 12D + 1)y = 0 
(ὁ) (2D? — 2/2 D+ 1)y = 0 


3-4 EXISTENCE AND UNIQUENESS OF SOLUTIONS; 
INITIAL-VALUE PROBLEMS 


On the strength of the results of the preceding section we can assert that every 
first-order linear differential equation which is normal on an interval J has solu- 
tions. In fact, it has infinitely many, one for each value of c in the expression 


= A(X) Stao(2)/ar(e) Ide | —Jlag(x)/a;(r)]dx = 
paler [19 dx e : (3-30) 


and the general solution of such an equation therefore is a one-parameter family 
of plane curves which traverse the strip of the xy-plane determined by 1, as shown 
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in Fig. 3-2. Even more important, it is easy to see that there is a solution curve 
passing through any preassigned point (xo, yo) in this strip, since (3-30) can be 
solved for c when x = Xo, y = Yo. 

The problem of finding a function y = y(x) which 15 a solution of a normal 
first-order linear differential equation and which also satisfies the condition 
y(Xo) = Yo 15 called an initial-value problem for the given equation. This termi- 
nology is designed to serve as a reminder of the physical interpretation which 
views such a solution as the path, or trajectory, of a moving particle which started 
at the point (xo, yo), and whose subsequent motion was governed by the equation 
in question. In these terms our earlier results can be summarized by saying that 
every initial-value problem involving a normal first-order linear differential 
equation has at least one solution. 


\ 
——— τς τος FIGURE 3-2 


At this point it is only natural to ask whether or not such a problem can admit 
more than one solution. This is the so-called uniqueness problem for first-order 
linear differential equations, and is anything but an idle question. Indeed, in appli- 
cations of differential equations to the natural sciences it is often essential to be 
able to guarantee that the problem being investigated has a unique solution, 
since any attempt to predict the future behavior of a physical system governed 
by an initial value problem relies upon this knowledge. In the case at hand, it is 
not difficult to show that the desired uniqueness obtains (see Exercise 14 below), 
and hence the above assertion can be amended to read as follows: 


Theorem 3-1. Every initial-value problem involving a normal first-order 
linear differential equation has precisely one solution. 


The general theory of linear differential equations can properly be said to begin 
with the theorem which generalizes this result to mth-order equations. In the 
special case treated above, the theorem was proved by the simple expedient of 
exhibiting all of the solutions at issue. Unfortunately, it is impossible to give an 
argument of this type for equations of higher order, and though the asserted 
theorem is true, its proof is not conspicuously easy. Thus, rather than become 
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involved in a Jong and.somewhat arid discussion at this time, we content ourselves 
with a formal statement of the result.* 


Theorem 3-2. (The existence and uniqueness theorem for linear differen- 
tial equations.) Let 


an(x) SZ ++ + ἀρὴν = A(X) (3-31) 


be a normal nth-order linear differential equation defined on an interval I, 
and let Xo be any point in I. Then if yo, ...  Yn—1 are arbitrary real numbers 
there exists one and only one solution y(x) of (3-31) with the property that 


γαο) = Vos V(X0) = γι...» "αὺ = Yn-1- (632 


As in the case of first-order equations, the problem of finding a solution of 
(3-31) which satisfies the n additional conditions given in (3-32) is called an 
initial-value problem with initial conditions 


Y(X0) = Yo. V(Xo) = »..-. sy" (x0) = Yn—-1- 


It is also worth noting that Theorem 3-2 can be phrased in the language of linear 
operators, in which case it assumes the following suggestive form: 


If L: eC"() — 6(7]) is a normal nth-order linear differential operator, there exists 
a unique inverse operator G: C1) — C"(1) such that 


ὦ L[G()] = h, for all ἃ in C(I), 
and 
(ii) G(A\(x0) = Yo. G(h)'(x0) = »..--.. GAY"? (%0) = Yn—1- 


When stated in these terms it is clear that the task of solving an initial-value 
problem for a normal linear differential equation comes down to finding an explicit 
form for the inverse operator G, since once G is known the problem 


y(Xo) = )ο»--- ,y"—(x9) ΞΞ Vn=15 


can be solved by computing the value of G(h). This point of view will be exploited 
in later chapters where much of our work will be directed toward finding G for 
specific classes of linear differential operators. As we shall see, G will turn out to 
be an integral operator of the type considered in Example 2 of Section 2-2. 


* For a proof the reader should consult E. Coddington, An Introduction to Ordinary 
Differential Equations, Prentice-Hall, Englewood Cliffs, N.J., 1961. 
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EXERCISES 


Find the solution of each of the following initial-value problems and specify the domain 
of the solution. 


1. xy + 2y =0, γα) = “-- 

2. (sin x)y’ + (cosx)y = 0, yl—] = 2 
3. 2y' + 3y =e, γ(-3  -- 
4. αἵ + ν΄ — Ud -- xy = e*, γε-2 = 


5: cone + (sinx + cosx)y = Ξ y(—4) = 0 
dx x 


6. x°y + 2 = 14-VI—- &, γνῷ = 
ΨΙ -- x2 : 


7. ([ + sin ne + (cot x)y = cos x, » (3) = | 


Use the given general solution to solve each of the following initial-value problems. 
8. y’ — κν = 0, yO) = γ'(0) = 1; y = ει sinhkx + cecoshkx,k ~ 0 


x—1 
9. ( -- x*)y” — 2xy’ = 0, y(—2) = 0, y(—2) = 1; y = οἱ + coln ar 
10. xy’ + y’ + xy = 0, γ() = γ΄ () = = αὐ οί) + c2Yo(x), where Jo and 


Yo are linearly independent solutions ae ae equation on (0, ©). 


11. 4x7" + 4xy’ + (4x — 1ὴν = 0, 6 = —l1,y’ () = 0; 


y= Pe fe (ci sin x + c2cos x) 
TX 
12. γ" + (tanx — 2cotx)y’ = 0, »(- *) = y' (- 4 = 1: 


. 8 
y=csin x + ce 


13. xy’ + yy’ = 0, y(—2) = γ(--Ζ25 = 1; y = c1 + coin |x| 

14. (a) Let γι: and y2 be solutions of a normal first-order linear differential equation on 
an interval 7. Prove that y; — yg is either identically zero or is different from zero 
everywhere on 7. 
(b) Use the result in (a) to deduce that every initial-value problem involving a normal 
first-order linear differential equation has at most one solution. 

15. Give an example to show that the conclusion of Theorem 3-2 fails when the hypothe- 
sis of normality is not satisfied. 

16. Let γι and y2 be distinct solutions of a normal first-order linear differential equation 
on an interval J. Prove that the general solution of the equation on 7 is 


yryv | 


Y1 — y2 


3 


where c is an arbitrary constant. [Hint: See Exercise 14(a).] 
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17. Prove that a nontrivial solution of a homogeneous first-order linear differential 
equation cannot intersect the x-axis. [Hint: Use Theorem 3-1.] 

18. Use the results of this section to prove that y = οἱ sin x + c2cos x is the general 
solution of y’ + y = Oon(—%, ©). [Hint: If u(x) is any solution on (—, ©), 
show that c, and ce can be chosen so that y(0) = u(0), γ'(0) = μ'(0), and then 
apply Theorem 3-2.] 

19. Show that two distinct solutions of a normal first-order linear differential equation 
cannot have a point of intersection. 

20. Prove that every nontrivial solution u(x) of a normal second-order linear differential 
equation 

ao(x)y” + ai(x)y’ + ao(x)y = 0 
has only simple zeros. [A point x9 is said to be a zero of a function u(x) if and only if 
u(xo) = 0. A zero of u(x) is simple if and only if u’(xo) τέ 9.1] 

21. Prove that distinct solutions of a normal second-order linear differential equation 
have no point of mutual tangency. 

22. Given the linear differential operator D, find the inverse operator G which satisfies 
σ(μ)ίχο) = Yo. 

23. Given the linear differential operator D — k (k a constant), find the inverse operator 
G which satisfies G(A)(xo) = Yo. 


3-5 DIMENSION OF THE SOLUTION SPACE 


In this section we shall use the existence and uniqueness theorem stated above to 
give a simple yet elegant proof of the fact that the dimension of the solution space 
of every normal homogeneous linear differential equation is equal to the order of 
the equation. The reader should note, however, that this result fails in the case of 
an equation whose leading coefficient vanishes somewhere in the interval under 
consideration (witness the equation xy’ + y = 0 on an interval containing the 
origin). 
This said, we now prove 


Theorem 3-3. The solution space of any normal nth-order homogeneous 
linear differential equation 


d” 
an(x) ἘΣ + +++ + ἀρὴν = 0 (3-33) 
defined on an interval I is an n-dimensional subspace of C(J). 


Proof. Let xo be a fixed point in J. Then by Theorem 3-2 we know that this equa- 
tion admits solutions y,(x),...,¥n(x) which, respectively, satisfy the initial 
conditions ; 

yi(xo) = 1, yi(%o) = 0,..-, xP (Xo) = 9, 


(n—1) 


Ya(Xo) = 0, yo(Xo) = 1,...,y2 (Xo) = 0, (3-34) 


Yn(Xo) oa 0, Yn(Xo) oe 0, οἶδ τ αῦ =. 


3-5 | DIMENSION OF THE SOLUTION SPACE 107 
In other words, y;(x), ..., ¥n(x) have the property that the vectors 


(y:(xo), yi(Xo), re) γῇ —Y'(xo)); i= l, .....2 ἢ, 


are the standard basis vectors in ®”.* (See Fig. 3-3.) We assert that these solu- 
tions are a basis for the solution space of (3-33). 


: : 

: | : yi (x) . 

r | 

| | | 
| 

| ! | 

| | 

| 

[ 

! 

| 


Yo(x) 
| 


FIGURE 3-3 


Indeed, suppose that c,,..., C, are real numbers such that 
C1¥1(X) + τ΄ + CrYn(x) = 0 
on 71. Then this identity, together with its first n — 1 derivatives, yields the system 
C1V1(X) + Coyo(x) + +++ + CrYn(x) = 0, 
C1y4(X) + coyo(x) + τ + Cnyn(x) = " (3-35) 
ery ΠΟ) + cay P(x) Fo + egy P@) = 0. 
Setting x = Xp, we obtain | 


C1yi1(Xo) + Coye(Xo) + τ“ + CnYn(Xo) = 9, 
C14 (Xo) ἘΣ Coy2(Xo) πὰ δ CnYn(Xo) ᾿Ξ 0, (3-36) 


ery Po) + cays (Χο) +o + cna’ P(x0) = 0, 
and (3-34) now implies that cy) = cg = "᾿Ξ ὦ = 0. Thus y,(x),..., yn(x) 


are linearly independent in C(I). 

It remains to prove that every solution of (3-33) can be written as a linear combi- 
nation of y,(x),..., }n(x). To this end let y(x) be an arbitrary solution of the 
equation and suppose that | 


y(Xo) = ao, V'(Xo) = 41, ..., yo) = An—-1- (3-37) 
* This choice of solutions has been illustrated in Fig. 3-3 for a second-order equation, 


in which case 
(y1(xo), y'i(xo)) = C1, 9), 
(y2(xo), ¥2(xo0)) = (0, 1). 
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Then by the uniqueness statement in Theorem 3-2 we know that y(x) is the 
solution of (3-33) which satisfies these particular initial conditions. But, using 
(3-34) again, we see that the function 
Aoyi(x) + aryo(x) - τ᾿" + Gn—1Yn(X) 
also satisfies this initial-value problem. Hence 
W(x) = aoyi(X) + αι») + +++ + Gn—1Ynl2), 
and it follows that y1(x), . .., ¥n(x) span the solution space of (3-33). With this, 


the proof is complete. ἢ 


We call the reader’s attention to the fact that the particular numerical values 
used to fix the solutions y,(x),..., Yn(x) did not really play an essential role in 
the argument given above. Indeed, the success of the proof depended only on the 
linear independence of the vectors 


(y(xo); yi(Xo), sey yy" '(%xo)), i= I, -+.5A, 


in ®”, and the choice made in (3-34) merely served to simplify our computations. 
For as long as these vectors are linearly independent, the system of homogeneous 
linear equations (3-36) will have a unique solution, and the c; will be zero, as 
required. ) 


EXAMPLE 1. The second-order equation 


d’y 


is normal on the entire x-axis, and thus its solution space is a 2-dimensional 
subspace of C(— οὐ, 0). Moreover, it is easy to show that the functions 


yi(x) = 3(e* + e *) = cosh x, 
yo(x) = (εἶ — e *) = sinhx 
are solutions of (3-38) on (— οὐ, oo), and since 
yi) = 1, γι(0) = 9, 
y20) = 0, =y2(0) = I, 


the argument given above implies that cosh x and sinh x are a basis for the solu- 
tion space of this equation. Thus the general solution of (3-38) is 


y = c,coshx + ce sinh x, 


where οι and Cc, are arbitrary constants. 
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EXAMPLE 2. The functions 


yi(x) Ξ 657, γι) = 
provide a second pair of solutions of Eq. (3-38). In this case 


γι(0) ΞΞ 1, γι(0) = 
y2o(0) = 1, γ4(0) = --ἰ, 
pe since the vectors (1, 1) and (1, —1) are linearly independent in 612, οἴ and 


* also form a basis for the solution space of the equation. It follows that the 
se: solution of (3-38) may also be written 


v= ce” ΞΕ Coe”, 


which, of course, is a variant of the solution obtained above. 


EXAMPLE 3. The functions 
yi(x) = sin 2x, Yo(x) = cos 2x 
are solutions of the normal second-order equation 


d’y 

3 + 4y = 0 (3-39) 
on (—o, o). Furthermore, y,(0) = 0, γ1(0) = 2, while y.(0) = 1, y3(0) = 0, 
and since (0, 2) and (1,0) are linearly independent vectors in 612, we conclude 
that sin 2x and cos 2x are linearly independent in C(— 0, 0). Hence they are a 
basis for the solution space of (3-39), and the general solution of that equation is 


y = c,sin2x + cq cos 2x. 


At this point it is impossible to escape the conclusion that in proving Theorem 
3-3 we also established a method for testing functions for linear independence. 
This fact is well worth bringing out into the open, since it will be used in the follow- 
ing sections to obtain a number of important results concerning (normal) linear 
differential equations. Specifically, we have | 


Corollary 3-1. Let y,(x),..., n(x) be functions in C1), each of which 
possesses derivatives up to and including those of order n — 1 everywhere 
in I, and suppose that at some point Xo in I the vectors 


(y:(x0), yilxo), ae | ye (xo)), i= Ls -- 2A, (3-40) 


are linearly independent in @”. Then y,(x),..., ¥n(x) are linearly inde- 
pendent in C(/). 
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EXAMPLE 4. The functions 


οἷ, xe, x7e” 


are linearly independent in C(— οὐ, «) since the above test applied at x = 0 
yields the linearly independent vectors (1, 1, 1), (0, 1, 2), (0, 0, 2) in 6.5. 


EXERCISES 


For each of the following homogeneous linear differential equations, (a) show that the 
given functions span the solution space of the equation on an appropriate interval, 
(b) choose a basis for the solution space from among these functions and use it to express 
the general solution of the equation, and (c) find a basis for the solution space of the 
equation which satisfies initial conditions of the form (3-34) at the given point xo. 


1, γ"" — γ" — 2y = 0; ε΄“, sinh x — 4e”,2e,1; xo = 0 
2. y" — y =0; coshx,e” + sinhx,e° + sinhx,coshx — 1; xo = 0 
3. (D* — 4D* + 7D” — 6D + 2)y = 0; 
xe”, (1 + xe’, ὁ — sin x), εἴα + sin x), e’cosx; xo = 0 
4. x°y!" 4 2x*y” — xy! + y = 0; 


Bae: x + xiInx, ἘΣ x(1 -- Inx); xo =e 
x x x 


3 
5. (x°D* — 2)y = 0: ΠΕ πε ge xo = 1 
x x 
a gee ee ἡ ee Pe ae en ee eee 
i eee ied 3 3 1+x 9 0 


7. Use the equation xy’ + y = 0 to show that Theorem 3--3 fails if the hypothesis of 
normality is not satisfied. 

8. Show that the following functions are linearly independent in C(J) for the given 
interval 1. 


(a) ε“", οὗ" (a τὰ δ); (--οὐὔ, &) 
(b) 1,x,x°; (—%, ο) 
x—1 
(c) 1, Int? (1, ©) 
(4) x, xInx; (0,0) | 
(e) e*” sin bx, e*” cos bx (ὁ # 0); (—%, ~) 
9. Prove that the functions 1, x, x?,..., x” are linearly independent in C(J) for any 
interval 1. 


#10. Suppose that yi(x),..., n(x) are solutions of a normal homogeneous linear dif- 
ferential equation of order m > n on an interval J. Prove that if yi(x),..., ¥n@) 
are linearly independent in (J), they are linearly independent in ΘΟ) for any sub- 
interval J of 1. Give an example to show that this result fails if y1(x),..., Yn(x) 
do not satisfy such an equation. 
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In the preceding section we proved that y,,...,y, are linearly independent 
functions in @C"—'(7) whenever there exists a point xo in J such that the vectors 


(y(x0), VilXo), “419 y—?(x0)), i= l, 22 ἤ, (3-41) 


are linearly independent in ®”. For our present purposes this result can be stated 
more conveniently in terms of the determinant of a certain matrix, as follows: 

Let yi,..., Jn be arbitrary functions in C”—'(/), and for each x in J consider 
the matrix 


yi(x) Yo(x) κε Yn) 
yi(x) y2(x) ‘++ Yn(*) (3-42) 


VP) γα) --- WTP) 


Then (3-42) defines a function on the interval J whose value at x is the indicated 
matrix, and by forming the determinant of this matrix we obtain a real valued 
function on J known as the Wronskian of y1,...,¥n. This function will be 
denoted by W[yy,...,n] to indicate its dependence on y;,..., yn, and its 
value at x by W[y,(x),..-., ¥n(x)]. In short, the Wronskian of y;,..., )n 18 
the (real valued) function whose defining equation is 


yi(x) Yo(x) "2+ Yn(x) 
Wrlx),---,%nO) = fie) γῸ -- AG) :- 6.435 
yP Por) yPTVPG) oo WPT) 
For example, 
x sin x 
W[x, sin x] = = xcosx — sin x, 
1 cosx 
and 
2x 
W[x, 2x] = = 


We now recall that the determinant of an n X n matrix is nonzero if and only 
if the columns of the matrix are linearly independent vectors in ®” (see Theorem 
III-8). Thus the Wronskian of y;,..., yn is different from zero at xo if and 
only if the columns of (3-42) are linearly independent when x = xp. But for 
each x, in J the columns of (3-42) are none other than the vectors in (3-41), and 
we therefore have the following theorem. 


Theorem 3-4. The functions γι, ..., Yn are linearly independent in e"—'(J), 
and hence also in C1), whenever their Wronskian is not identically zero on I. 
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EXAMPLE 1. Since 


& -ὖὸ 


Wle’,e “] = 


τ = eo * 


the functions οὗ and e~” are linearly independent in C(/) for any interval J. 


EXAMPLE 2. The functions x, x'/?, x°/? are linearly independent in @(/) for 
any subinterval J of the positive x-axis since 


Wx, χ᾿ "3, x? /7] = |1 ἀχ 15 gyll2 | - --ὰ 
0 a gy 12 
More generally, x“, x°, x” are linearly independent in Θ(7), J as above, if and only 
if a, 8, Y are distinct real numbers (see Exercises 13 and 14 below). — 
EXAMPLE 3. The functions x? and |x|® are linearly independent in C(— οὐ, οὐ), 
for if cx? + co|x|*? = 0, then 
c,(1)? + c,/1|? = 0, 
e1(—1)* + c2|—1]° = 0, 


and εἰ = ¢, = 0. On the other hand, the Wronskian of x° and [χ 3 is identically 


zero on (— οὐ, 0) since i 
3 3 
x 
WIx?, |x|?] = = 0, 
I 3x? 3x? 
if x > 0, and 
3 3 
x —x 
Wx’, [χ[ "] = = 0, 
ν᾿ 3x? —3x? 


if x < 0. Thus the converse of Theorem 
3-4 1s false, and one cannot deduce the FIGURE 3-4 
linear dependence of a set of functions in 

Θ(7) from the fact that their Wronskian vanishes identically on 1. (See Fig. 3-4). 


This example notwithstanding, it is true that the Wronskian of a linearly 
dependent set of functions in C(/) vanishes identically on J, provided, of course, 
that the Wronskian exists in the first place. Hence, rather than abandon the 
search for a converse to Theorem 3-4, we weaken our requirements, and ask 
whether it is possible to impose additional conditions on a set of functions which, 
together with the vanishing of their Wronskian, will imply linear dependence. 
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This can in fact be done, simply by requiring that the functions be solutions of a 
homogeneous linear differential equation. We prove this assertion as 


Theorem 3-5. Let y1,..., Yn be solutions of a normal nth-order homoge- 
neous linear differential equation 


“ag(x) FX $+ + αρρὺν = 0 (3-44) 


on an interval I, and suppose that W[y,,..., ¥n] is identically zero on I. 
Then y1,..., Yn are linearly dependent in C(J). 


Proof. Let xo be any point in J, and consider the system of equations 


C1V1(Xo) Ἔ τ + CrYn(Xo) = 0, 


C1Yi(Xo) + τ + Cnyn(Xo) = 0, (3-45) 


cry (Χο) τ -- + cay P(x0) = 0, 


in the unknowns c,,...,C,. Since the Wronskian of y,,..., ¥, vanishes identi- 
cally on J the determinant of (3-45) is zero, and the system has a nontrivial solution 
(C1,...,€n). (See Theorem III-9.) Thus the function 


yx) = Styx) 
ἐξ] 


is a solution of the initial-value problem consisting of (3-44) and initial conditions 


γαὺ = 0, (Xo) = 0,..., 9% M(Xo) = 0. 


But the zero function is also a solution of this problem, and hence Theorem 3-2 
implies that 


Cryi(X) + τ. + Sayn(x) = 0 


for all x in 1 The linear dependence of y,,...,¥, now follows from the fact 
that the c; are not all zero. J 


Once again we have established a result which is stronger than the one adver- 
tised. For the above proof only made use of the fact that the Wronskian of 
Y1,--+,5Yn Vanished at a single point in J, and hence the conclusion remains true 
under this more restrictive hypothesis. Combined with Theorem 3-4 this obser- 
vation yields 


Theorem 3-6. A set of solutions of a normal nth-order homogeneous linear 
differential equation is linearly independent in C(I), and hence is a basis for 
the solution space of the equation, if and only if its Wronskian never vanishes 
on I, 
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EXAMPLE 4. By direct substitution the student can verify that sin? x and 1/sin? x 
are solutions of 


2 
oy + tan x a — 6 (cot? χὴν = 0 (3-46) 


on any interval Jin which tan x and cot x are both defined. Moreover, 


Φ 1 
sin? x ae 
w! sin? Ι a” sm’ x} _ 5 
sin X, ne: + > = 2 re = COS X. 
3 sin? x cos x Ξεύξ το. 
sin? x 


Since cos x is never zero on J, the above theorem implies that sin® x and 1/sin? x 

are linearly independent in C(/), and the general solution of (3-46) therefore is 
ἕο 

sin? x 


y = ¢, sin? x + 


(Note that this result can also be obtained directly from Theorem 3-4.) 


EXAMPLE 5. The functions 


yi(x) = sin? x, γοί(χ) = sinx — 4sin 3x 
are solutions of 
2 
ΤΣ  ((ἀηχ — 2cot 2 = Ὁ (3-47) 


on any interval Jin which tan x and cot x are defined. But 


. 3 e 1 . 
sin’ x sin x — 4sin 3x 
γι), yo(x)] = : 


3 sin? x cos x cos x — cos 3x 


Ι! 


sin? x(cos x — cos 3x) — 3 sin? xcos x(sin x — 2 βίη 3x) 


sin? x(sin 3x cos x — sin x cos 3x) — sin” x(2 sin x cos x) 


sin? x sin 2x — sin? xsin2x = 0. 


I 


Hence y, and yg are linearly dependent in C(/), and do not form a basis for the 
solution space of (3-47).* In this case, however, it is clear that any constant c 
is a solution of (3-47), and since ς and sin® x are obviously linearly independent 
in C(/), the general solution of the equation is 


y = cy + cgsin® x. 
Of course, this expression may also be written 


y = cy + co(sinx — ¥sin 3x). 


* In fact, sin? x = 2sinx — isin 3x. 


3-6 THE WRONSKIAN 115 


EXERCISES 


By computing Wronskians, show that each of the following sets of functions is linearly 
independent in Θ(7) for the indicated interval 1. 


—_—, 


oO NNN WN 


10. 
11. 
12. 
13, 


14. 


15. 


16. 


17. 


. 1, e7*, 263: on any interval J 
. e”, sin 2x on any interval I 
τὰς eA a ee on any interval 7 
.Inx, xInx on (0, ©) 

x2. x 1/3 on (0, 0 ) 
. e* sin bx, e* cos bx (ὁ # 0) on any interval J 
. e*, e*sinx on any interval 7 
. e7*, χο 1, x%e—* on any interval J 
. 1, sin? x, 1 — cosx on any interval J 

χ-- 1 

ay? on (—«, —1) 

V1 — x*,x on (—1, 1) 

sin - , COS? x on any interval J 

Show that χα, x®, x7 are linearly independent in C(0, ©) if and only if a, 8, Y are 


distinct real numbers. [Hint: If a, B, Y are distinct and cyx* + cox® + c3x7=0 
on (0, ©), show that c; = c2 = 63 = O by considering what happens as x tends 
to .] 

Show that χὰ, x®, x7’ are linearly independent in C(O, ©) if and only if they are 
linearly independent in C(J) for every subinterval J of (0, ©). [Hint: First establish 
both of the following assertions, and then use Theorem 3-6: 


(a) x%, x®, x7 satisfy the linear differential equation 
χϑγ'" + agx?y" + ayxy’ =e agy = 0, 


whereag = 3 —-a—B-—Y,a1 =1—a—B—YVY+a6 + ΑὟ + BY,a0 = --αβΎ. 
1 1 1 
(b) W(x%, xP, x") = x tBtT τ g β Y 1: 
α(α -- 1) βίβ -- 1) YY -- 1) 


and hence W(x%, x®, x7) either vanishes nowhere in (0, ©) or vanishes identically. ] 


Generalize the results of Exercises 13 and 14(b) to show that x1, ..., x are linear- 
ly independent in C(J for any subinterval J of (0, ©) if and only if a1,...,a, are 
distinct real numbers. 

Let f belong to C![a, δ], and suppose that fis not the zero function. By computing 
their Wronskian show that f(x) and xf(x) are linearly independent in C![a, δ]. 
(Also see Exercise 17.) 

Show that f(x) and xf(x) are linearly independent in C[a, 6] if fis continuous and 
not identically zero on [a, 6]. . 
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18. 


19. 


*20. 


Ἐ21. 


122; 


23: 


24. 


25. 
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Suppose that f is an odd function in C![—a, a] (that is, f(—x) = —f(x)) and that 
Ff) = 5}, (0) = 0. Show that 


WLE(x), [ΟἹ] = 0 


for all x in [—a, a], but that f and | f| are linearly independent in C![—a, a] unless 
fis identically zero. Compare this result with Example 3 in the text. 

Let αὶ g be any two functions in C!(J), and suppose that g never vanishes in J. 
Prove that if WL f(x), g(x)] = 0 on J, then fand g are linearly dependent in Θ΄ (ἢ. 
[Hint: Calculate d/dx( f(x)/g(x)).] 

Let f, g be any two functions in C!(J which have only finitely many zeros in J and 
have no common zeros. Prove that if WL f(x), g(x)] = 0 on J, then f, g are linearly 
dependent in Θ᾽ (ἢ. [Hint: Apply the result of Exercise 19 to the finite number of 
subintervals of J on which f or g never vanishes.] 


(a) Show that 


1 1 1 

aj a2 An, 

oon 2 2 2 

Wie"",...,e"] = ett tan)? aj a2 Pt a 
n—I n—l n—1 

a a2 An 


(b) The determinant appearing in (a) is known as a Vandermonde determinant. 
Show that it is zero if and only if a; = a; for some pair of indices i, j with i ¥ /. 
[Hint: Expand the determinant by cofactors of the 1st column to obtain a poly- 
nomial in a;. Is a2 a root of this polynomial ?] 
Prove that if wi,...,u, is a basis for the solution space of the linear differential 
equation 

y™  α,.. οὐ)» Ὁ + +++ + ao(xy = 0, 


then the a;(x),0 < i < n — 1, are uniquely determined by uj,..., Un. [Hint: For 
each index i, let uv), be the solution of the given equation which satjsfies the initial 
conditions uf, (xo) = 0, O< j<n-—1, j Xi, and uf%,(xo) = —1. Then 
a;(xo) = uf, (x0)-] 
Let μι and ue be linearly independent solutions of the normal second-order linear 
differential equation 
γ᾽" + ai(x)y’ + ao(x)y = 0. 

Express the coefficients ao(x), a1(x) in terms of μι and uz. (Hint: Let y be an arbi- 
trary solution of the equation, and consider the Wronskian of y, μι. u2.] 
Generalize the result of the preceding exercise to an nth-order equation 

y™ + ἀρ. ταὐ)ν Ὁ + +++ + aoGdy = 0. 
Use the results of Exercise 23 to find a homogeneous second-order linear differential 
equation whose solution space has the following functions as a basis. 
(a) x, xe” (b) x, x? 
(c) sin x, cos x (d) x, sinx 
(e) x, Inx 
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According to Theorem 3-6 the Wronskian of a set of solutions of a normal 
homogeneous linear differential equation either vanishes identically or not at all. 
This fact can also be deduced from the following theorem, which gives an explicit 
formula for the Wronskian in this case. 


Theorem 3-7. Let y1,..., Yn be solutions on an interval I of the nth-order 
equation 
=} 


δ νυν ao(x)y = 0, (3-48) 


d"y d” 
On(X) Fn ar An —1(X) dx 
and suppose that a,(x) ¥ 0 everywhere in I. Then 

Wy r(x), + «5 YaCX)] = ce Mees @rentarite (3-49) 


for an appropriate constant c. (This result is known as Abel’s formula for 
the Wronskian.) 


Proof. In order to avoid using general properties of determinants, we shall prove 
(3-49) only in the case n = 2. The general proof is identical, except that it uses 
the formula for the derivative of an nth-order determinant (see Exercise 9). 

Thus suppose that y,; and y2 are solutions of 


d° d 
a(x) 55 + a(x) ας + ao(x)y = 0 


on an interval J in which a2(x) does not vanish. Then 


γι(Χ) γω(Χ) 
γι) yo(x) 
= £ τοῦ») -- ri 

= yilx)yo(x) — yi'()yo(x) 

- y:09| -- A) yyy -- Gol) va) 


£ Winx), yO) = 5 


a2(x) a2(x) 


J) - AX) yyy _ Gol) νὴ] 


a2(x) a2(x) 
_ 4a 1(x) 


ἘΞ [»1(χ)»2(Χ) -- yolx)yi(x)] 


αο(Χ) 


= - 2) Wy), yo(x)]. 


a2(x) 


Thus W[yi(x), yo(x)] is differentiable on J, and satisfies the first-order linear 
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differential equation 


ae ΤΩΝ -- 0. 


Go(x) > 


But the general solution of this equation is 


y= eo! (ay (2)/ag(z)]da 


and hence, for an appropriate value of c, we have 
Wyilx), yo(x)] = co Ptr mlosmiee, 


as asserted. J 


If xo is any fixed point in J, and if W(xo) denotes the value of the Wronskian 
of y1,... 5 }n at Xo, then Abel’s formula may be written in the form 


Wi(0), 5 γκ ΑἹ = Wx )e "πο Mande, (3-50) 


This formula shows that the Wronskian of any basis for the solution space of a 
normal homogeneous linear differential equation is determined up to a multi- 
plicative constant by the equation itself, and does not depend upon the particular 
basis used to compute it. This simple observation will be important later on. 


EXAMPLE 1. Since 
xB t+ dx ae a 


is normal on (0, «), the Wronskian of any two solutions y, y2 of this equation 


must be of the form , 
W[yi(X), yo2(x)] = eek = τ 5 


If, in addition, y, and yg satisfy the initial conditions 


yi(xXo) = ao, Vi(X%o) = 41, 
yo(Xo) = bo, y2(%o) = by, 


at some point xo > 0, then 


ἀρ 0 
Cc = Xo = X0(aob1 — aybo), 
ay 1 
and 
δι — a,b 
gli), ya)] = Σοίσονι — 21?) 


* This result actually holds for all n > 2, provided that a1(x) and a2(x) are replaced 
by @n—1(x) and a,x), respectively. 
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As our first substantial application of Theorem 3-7 we shall use Abel’s formula 
to find the general solution of a second-order homogeneous linear differential 
equation given one nontrivial solution of the equation. Thus let y; #0 be a 
solution of 


a2(x)y”’ + ai(x)y’ + any = ὁ (3-31) 


on an interval Jin which a(x) τέ 0. Then every solution y2 of (3-51) must satisfy 
the equation 


νι), ya(x)] = cof tr mlorteide, (3-52) 


and y. can thus be found by solving the nonhomogeneous first-order equation 


d -- [a;(xz)/ao(x)]dx 


By (3-20) the general solution of this equation is 


2.> on) [3 


where k is an arbitrary constant, and since this formula is valid on any sub- 
interval of J in which y,; # 0, it can be used to determine a second solution of 
(3-51) on such a subinterval. In particular, the function 


—f{a,(x)/ag(x)]dz 


νι) dx + ky,(x), 


—f [ay (x)/ag(x)]dz 


yo(x) = yilx) | ar ae dx 


will be such a solution, and is clearly linearly independent of y,, as desired. Thus 
we have proved the following theorem. 


Theorem 3-8. Jf y, is a nontrivial solution of Eq. (3-51) on an interval in 
which a(x) does not vanish, then 


—f [ay (2)/ag(x)]dx 


ya(x) = yi) [ Ἐπ - dx (3-53) 


is a solution of the equation on any subinterval of I in which γι τέ 0. More- 
over, V2 is linearly independent of γι. and the general solution of (3-51) is 


y= C11 + Cayo, 
where σι and Co are arbitrary constants. 


EXAMPLE 2. By direct substitution we find that x? is a solution on (0, 0) of 
the second-order equation 


χἕγ' + x3y — 21 + χὴν = 0. (3-54) 
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Hence a second linearly independent solution in C(O, oo) can be found by solving 


the first-order equation 


χἕγ' — 2χν = eT !?, 


Using Formula (3-53), we obtain 
—fadzx 
e 
Yo = x" | ar dx 


__ 2 
ae 4g Ὁ 12 dy. 


and the general solution of (3-54) on (0, «) is 


y= x? (c: +- Co [ χ te 112 ax) ‘ 


Here the solution must be left in integral form since fx—*e—*/? dx cannot be 
expressed in terms of elementary functions. 


EXAMPLE 3. The function y, = 1 is a solution of 
γ᾽ + (tanx — 2cotx)y’ = 0 (3-55) 


on any interval in which tan x and cot x are both defined. Applying the above 
result we obtain a second solution 


yo(x) = | ae cot x)dz dx 


zs pene sin2 x)dz dx 


[ sin” x cos x dx 
= isin? x. 

Thus the general solution of (3-55) 15 
y = c1 + ce sin® x, 


which agrees with the result obtained at the end of the last section. 


EXERCISES 


1. For each of the following differential equations find the Wronskian of the solutions 
y1, y2 which satisfy the given initial conditions. 


(a) χ' + xy’ + (x? + τὴν = 0; yi) = 0, AC) = 1, yo) = γα) = 1 
(0) A -- χ)ν" — 2χν' + n(n + 1)y = 0 (ra positive integer); 
yi(0) = γί (0) = 2, yo(0) = 1, y2(0) = —1 
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(c) xy” — 3xy' + y = 0; yi(—1) = y(—1) = 2, γε(--1) = 0, 
yo(—1) = -1 

(4) γ" + 2xy = 0; γι(0) = yi) = 1, y2(0) = 1, y2(0) = 0 

(e) γ΄ — (sin x)y’ + 3 (tan x)y = 0; 
yi(0) = 1, yi) = 0, y2(0) = 0, y2(0) = 1 

(Ὁ V1 + x8 yp” — x*y + y = 0; yi) = 1, yi) = 0, yo) = 1, 
y2(1) = 1 


In Exercises 2 through 8, one solution of the differential equation is given. Find a second 
linearly independent solution using the method of this section. 


ῥιΑ 


»" -- 4y’ + 4y = 0; e” 


3. y’ — 2ay’ + a*y = 0 (aconstant); e* 


3xy’ — y’ = 0; 1 


. y’ + (tan x)y’ — 6(cot? χὴν = 0; sin? x 


(1 — x?)y’’ — 2xy’ = 0; 1 


. (1 — x?)y” — 2xy’ + 2y = 0; x 
. 2χγ'" — (e*)y’ = 0; 1 
. (a) Prove that if f; is in C1(D, 1 < i, j < 2, then so is the function F defined by 


μιὰ) fia) 


F(x) = ? 
δια) fa2(x) 
and that 
d κι) fie(x) " Ια) 206) Αια) fia(x) 
ἀκ | fai(x) forlx)| | fale) 2] | fare) fool) 


(Ὁ) Generalize the result in (a) to the case of nmth-order determinants; and show, in 
particular, that 


μια) fio) τ. fin&) 
ὦ δι) foxx) .-- fen(x) 
dx|: : 

Fri) Fn2(x) evs Inn(x) 


can be expressed as the sum of m determinants, the ith of which is obtained from 
| f:;(x)| by differentiating the functions in the ith column. 
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By now it should be obvious that the theorems we have in hand are powerful 
tools for studying linear differential equations. What is not so obvious, however, 
is that they can also be used to obtain detailed information about the solutions 
of an individual equation, and before going any further we propose to illustrate 
this aspect of our results. Since this method is applied almost exclusively in 
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rather complicated situations we have chosen to introduce it by means of an 
example which, though somewhat artificial, has the merit of absolute clarity. 
In the process we will undoubtedly give the impression of someone who 15 reso- 
lutely shutting his eyes to the obvious (which, in fact, is what we shall be doing), 
but the reader should nevertheless appreciate that the technique in question and 
the spirit underlying its application are of considerable importance. 
The problem we set for ourselves is to study the solutions of the second-order 
equation 
Yr y= 9% (3-56) 


without using any information other than that provided by the equation itself 
and the general theorems proved above. 

In the first place, this equation is normal on (— οο, οὐ), and we can therefore 
apply Theorem 3-3 to assert that its solution space is spanned by two linearly 
independent functions, C(x) and S(x), which are defined for all x and satisfy 
the initial conditions 

C(O) = 1, C’(0) = 0, 


3-57 
S(O) = 0, S’(0) = 1. ( ) 

Moreover, from the identities 
C’(x) + C(x) = 0, S”’(x) + S(x) = 0, (3-58) 


valid for all x, we conclude that both C(x) and S(x) are infinitely differentiable 
on (— οὐ, οὐ), and that all of their derivatives are solutions of (3-56). For example, 
the identity C’’(x) + C(x) = 0 implies that C’’(x) is differentiable, since C(x) 15, 
and that σ΄") + C’(x) = 0. But this is just (3-56) again with C’(x) in place 
of y; S’(x) is treated similarly, and the argument can be repeated to establish 
the assertion for still higher derivatives. In particular, 


C(x) = —C%(x), SX) = --δ 0), 
C(x) = C(x), Sx) = 80), 


and the derivatives of C(x) and S(x) repeat in cycles of four, as expected. Finally, 
(3-57) and (3-58) imply that 


C’(0)= Ὁ, Cc’O)= --ἰ, 
5.0) Ξ- 1, S’@) = 0, 


and it follows that C’(x) is the solution of (3-56) which satisfies the initial con- 
ditions C’(0) = 0, C’(0) = —1, while S’(x) is the solution which satisfies 
S’(0) = 1, S’(O) = O. Thus 


C(x) = --δ), 5.) = CX), 


and we have evaluated all of the derivatives of C(x) and S(x). 
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Using these results we can now prove the familiar identity 


S(x)? + C(x)? = 1. (3-59) 
Indeed, since 


£ [S(x)? + Clx)"] = 250) 5) + 2) Ο Ὁ = 0, 


it follows that 
S(x)? + C(x)? = k, 


kK a constant. Setting x = 0 gives k = 1, as asserted. Among other things, 
(3-59) implies that |C(x)| < 1, |S(x)| < 1 for all x. 
Next, we establish the important addition formulas 


Cla + x) = (ως) — S(a)S(x), 


(3-60) 
δία + x) = S(a)C(x) + C(@S(x), 


a an arbitrary real number. To do so, we note that 
d* 3 
τς ((α - x) = --((α - x) and τς δία + x) = —S(a + x). 
dx dx 


Thus C(a + x) and δία + x) are solutions of (3-56), and as such must be linear 
combinations of C(x) and S(x); that is, 


Cia + x) = a,C(x) + aeS(x), 


(3-61) 
δία + x) = BiC(x) + BeS(x) 
for suitable constants a4, ao, B81, βο. To obtain the values of these constants we 
set x = 0 in (3-61) and the identities obtained from it by differentiation. This 
gives a; = C(a), By = S(a), ag = —S(a), By = C(a), and (3-60) has been 
proved. 
In much the same fashion it can be shown that 


C(—x) = CX), = S(—x) = —S(), (3-62) 


and we conclude that the graph of C(x) is symmetric about the y-axis, while that 
of S(x) is symmetric about the origin (see Exercise 1). 

At this point we could derive those long and all too familiar lists of trigonometric 
identities involving C(x) and S(x). However, it is much more instructive to prove 
that these functions are periodic with period 27. Here we begin by defining 1/2 
to be the smallest positive real number such that C(x) = 0. (The proof that such 
a number exists has been left to the student in Exercise 2.) Then C(x) is positive 
on the interval (0, 7/2), and since S’(x) = C(x), we conclude that S(x) is in- 
creasing on that interval. But S(O) = 0, and hence S(x) is also positive on (0, 7/2). 


124 GENERAL THEORY OF LINEAR DIFFERENTIAL EQUATIONS | CHAP. 3 


Thus by (3-59), 5(1,,2) = 1, and the addition formulas now give 


Cir) = -1, CQ@r/2) = 0, Cn) = 1, 
S(x) = 0, SGr/2)= —-1, δε) Ξ 0. 


Hence 
C(x + 2m) = C(x)CQr) — S(xX)SQxr) = C(x), 
S(x + 2πὴ = S(xX)CQr) + C(xX)SQ7) = 50), 


and the periodicity of C(x) and S(x) has been established. 

To complete the discussion it remains to show that 27 is the smallest period 
for each of these functions. For C(x) the argument goes as follows: From (3-61) 
we obtain 

C(x + m/2) = — S(x), 
C(x + πὴ = —S(), 
C(x + 32/2) = S(x), 


and it follows that C(x) is negative on the interval (7/2, 37/2), positive on 
(32/2, 27). For similar reasons S(x) is positive on (0, 7), negative on (7, 27). 
But since C’(x) = —S(x), C(x) is decreasing on (0, x) and increasing on (1, 27). 
This, together with C(3x/2) = 0 and C(27) = 1, implies that 27 is the smallest 
positive real number such that C(x) = 1, and we are done. 


EXERCISES 


1. Establish the identities (3-62) by showing that C(— x), S(—<x) are solutions of (3-56) 

and expressing them in terms of the basis C(x), S(x) for the solution space. 
*2. Show that there is a least positive real number a such that C(a) = 0. [Hint: Assume 

the contrary; then argue that 
(a) C(x) > 0 for 0 < x < -&, 
(Ὁ) Sx) > Ofor0 <x < a, 
(c) C(x) is strictly decreasing and concave downwards on (0, ~), 
and derive a contradiction from (a) and (c).* Having established that C(x) has 
positive zeros, consider the greatest lower bound a of the set of positive zeros of C(x).] 

3. Let E(x) be the unique solution on (— ©, ©) of the initial value problem y’ — y = 0, 
y(0) = 1. Establish the following properties of E(x): 
(a) E(x) has derivations of all orders, and E™(x) = E(x); 
(Ὁ) E(x) > 0 on (0, ©); [Hint: Otherwise let xo be the smallest positive real number 
for which E(xo) = 0, and derive a contradiction by applying the mean value theorem. 
(Why would such a smallest number exist ?)] 


* To establish these facts rigorously, the intermediate value theorem and mean value 
theorem from calculus must be applied. The student, however, may give an intuitive 
argument based on a consideration of the graphs of C(x) and S(x). 
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(c) E(x) is strictly increasing and concave upwards on (0, ©); 
(d) E(a + x) = E@EQ() for all real numbers a, x; 


(e) E(—x) = wD for every real number x; [Hint: Apply ().] 


(Ὁ 0 < E(x) < 1 on (-~, 0); 
(6) lim E(x) = ©; (Aint: Use (c).] 


(h) lim E(x) = 0; 


(i) Set E(1) = e, and show that E(n) = e”. 
. (a) Prove that every solution of a homogeneous linear differential equation with 
constant coefficients has derivatives of all orders at every point on the x-axis. 


(Ὁ) Generalize this result to homogeneous equations with variable coefficients and to — 
nonhomogeneous equations. 


4 


equations with 


constant coeflcients 


4-1 INTRODUCTION 


Linear differential equations with constant coefficients, that is, equations of the 
form | 
any™ + dnay*™—? + +++ + acy = h(x) (4-1) 


in which do,..., a, ~ 0 are (real) constants, are in many respects the simplest 
of all differential equations. For one thing, they can be discussed entirely within 
the context of linear algebra, and form the only substantial class of equations of 
order greater than one which can be explicitly solved. This, plus the fact that 
such equations arise in a surprisingly wide variety of physical problems, accounts 
for the special place they occupy in the theory of linear differential equations. 

We shall begin the discussion of this chapter by considering the homogeneous 
version of Eq. (4-1), which can be written in normal form as 


(D® + ay_,D"-! + +++ + agp = 0, (4-2) 
OT aS 
Ly = 0, (4-3) 


where L is the constant coefficient linear differential operator D” + a,_,D"~ 1 + 
-++ + ay. Algebraically such operators behave exactly as if they were ordinary 
polynomials in D, and can therefore be factored according to the rules of ele- 
mentary algebra. In particular, it follows that every linear differential operator 
with constant coefficients can be expressed as a product of constant coefficient 
operators of degrees one and two (see Exercise 2 below). As we shall see, this 
essentially reduces the task of solving (4-2) to the second-order case where com- 
plete results can be obtained with relative ease. 

This done, we will take up the problem of finding a particular solution of 
Ly = h given the general solution of the associated homogeneous equation 

126 
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Ly = 0 (see Section 3-2). Here the restriction on the coefficients of 1, will be 
dropped and much more far reaching results obtained. The language of operator 
theory and the ideas of linear algebra will dominate this portion of our discussion 
and furnish just that measure of insight needed to make it intelligible. Finally, 
we shall conclude the chapter with some special results involving constant coef- 
ficient equations and a number of applications to problems in elementary physics. 


EXERCISES 


1. (a) Prove that the product of two complex numbers a + bi and c + di is real if 

and only if either 

(Ὁ ὁ = ὦ = 0, οὗ 

@i)a=c and b= —d. : 
[Hint: Recall that a complex number a + δὶ is real if and only if ὁ = 0, and that 
a product of the form (a + bi)(c + di) is computed by using the distributive law 
and the rule i? = —1.] 
(b) Let P(x) be a polynomial with real coefficients, and suppose that P(x) has 
a-+ bi, b > 0, asa root; that is, Pa + bi) = 0. Prove that a — δὲ is also a root 
of P(x). 

2. Let P(x) be a polynomial of degree n, n > 0, with real coefficients. Use the fact 
that P(x) has exactly n roots in the complex number system to prove that P(x) can 
be factored into a product of linear and quadratic factors with real coefficients. 
[Hint: See Exercise 1(b) above. ] 

3. Find the second-degree polynomial which has a + bi and a — bi, b > 0, as roots. 

4. Prove that every polynomial of odd degree with real coefficients has at least one real 
root. [Hint: See Exercises 1(b) and 2 above.] 

5. Write each of the following linear differential operators as a product of operators of 
degrees one and two. 

(a) D? + 4D2 + 5D+ 2 (b) D? — D?+ D—-1 
(c) D* + 2D? — 10D — 25 (d) D* — 5D? + 4 
(e) D* + 2D? + 10 
6. Factor the operator D* + 1 into a product of operators with real coefficients. 
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We have already emphasized that the technique for solving constant coefficient 
linear differential equations depends upon the commutativity of the operator 
multiplication involved. To make this dependence explicit, and at the same time 
phrase it in the form best suited to our immediate needs, we begin by establishing 


Lemma 4-1. Jf L,,...,Ln are constant coefficient linear differential 
operators, then the null space of each of them is contained in the null space 
of their product. 
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Proof. To prove this assertion we must show that (L,...Z,)y = 0 whenever 
L;y = 0. But this is a triviality since 


(L,...L,)y = hi... Τρ γα ον ΤῸ} 
(L,...Li-hi4i... ΤΠ} (1.}) 


τς δ 
0.8 


Ι 


EXAMPLE. The second-order equation 


(D? — 4)yy = 0 (4-4) 
may be rewritten 
(D + 2)(D — 2)y = 0. 


Hence 655 and e~ * are solutions of (4—4) since they are, respectively, solutions of 
the first-order equations (D — 2)y = 0 and (D+ 2)y = 0. Furthermore, 
these functions are linearly independent in C(— oo, «) (compute their Wronskian!), 
and it therefore follows from Theorem 3-3 that the general solution of (4-4) is 


y = cye** + coe—**, 


οι and Cz arbitrary constants. 
This simple example suggests that we attempt to solve the general second-order 

equation | 
(D* + a,D + ao)y = 0 (4-5) 


by decomposing the operator D? + a,D + ag into linear factors. To this end 
we first find the roots a1, ag of the quadratic equation 


γι" + aym + ay = 0 (4-6) 
known as the auxiliary or characteristic equation of (4-5), and then rewrite (4—5) as 
(Ὁ — ai)(D — αοὺ)ν = 0. (4-7) 


This done, the argument falls into cases depending on the nature of a, and ag, 
as follows: 


Case 1. αι and ας real and unequal. Here the reasoning used in the above ex- 
ample carries over without change; the functions οι and e%2* are linearly in- 
dependent solutions of (4-7), and 


y = cye™" + cge*2" 
is the general solution. 


Case 2. a; = a2 = a. In this case (4-7) becomes 


(ὃ -- a)*y = 0, (4-8) 
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and our earlier argument yields but one solution of the equation, namely e%’. 
Using it, however, we can apply the method introduced in Section 3-7 to find a 
second linearly independent solution by solving the first-order equation 


We, y(x)] = e°**. 


An easy computation reveals that up to multiplicative constants, y(x) = χοῦ, and 
hence that the general solution of (4-8) is 


y= (C1 + Coxje™. 


Case 3. αἱ and ag complex. Here αἱ = a+ δὶ, ag = a — bi, a and 5B real, 
b > 0, and the above method apparently breaks down. Nevertheless, if we pre- 
tend that e*1* and e%2” continue to make sense when a, and ag are complex,* 
the discussion under Case 1 would imply that the general solution of (4~7) is 


I 


ce"! + 026 25 
= cet one + exe 


τς e"(cye* + (96. 5). 


y 


At this point we invoke Euler’s famous formula 
tx 


οἷ = cosx + isinx 


(see Exercise 34) to rewrite this expression as 


e""[c,(cos bx + isin bx) + c2(cos bx — isin bx)] 
e"T(c, + C2) cos bx + i(c, — C2) sin bx] 


c3e** cos bx + c4e* sin bx. 


y 


Thus, on purely formal grounds we are led to e®* cos bx and e sin bx as a basis 
for the solution space of (4-7) when a; = a+ biand ag = a — bi. Of course, 
we must now verify that these functions actually are solutions of the given equa- 
tion, and that they are linearly independent in C(— ©, ©). But this is routine and 
has been left as an exercise for the reader. 

Since these three cases include all possible combinations of a, and a2, we have 
completed the task of solving the general second-order homogeneous linear dif- 
ferential equation with constant coefficients. For convenience of reference we 
conclude by summarizing our results. 

To solve a second-order homogeneous linear differential equation of the form 


(D? + a,D + ap)y = 0, 


* Properly interpreted they do, as the reader may verify by consulting any text on the 
theory of functions of a complex variable. 
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first find the roots a, and ay of the auxiliary equation 
m? + aym + ap = 0. 


Then the general solution of the given equation can be expressed in terms of a, and 
as as follows: 


Q1, a2 General solution 
Real, a, τέ ao cye"1* + cg2e%2 
Real,a; -Ξ αὐ =a (ει + ceox)e** 


Complex, αι = a-+ bi e**(ce; cos bx + c2 sin bx) 
ag =a — bi 


EXERCISES 


Find the general solution of each of the following differential equations. 


ly’ +y’—2y = 0 2. 3y” — Sy’ + 2y = 0 
3. 8y’’ + 14y’ — 15y = 0 4. y’ — 2y’ = 0 

5. y’ + 4y = 0 6. 3y”’ + 2y = 0 

7. γ' + 4y’ + ὃν = 0 ὃ. 4y’’ — 4y’ + 3y = 0 
9. y’ — 2y’ + 2y = 0 10. 9y’’ — 12y’ + ἄν = 0 
11. y’ + 2y' + 4y = 0 12. 2y’ — 2/2y + y = 0 
13. 2y’ — 5V/3y’ + 6y = 0 14. 9y” + 6y’ + y = 0 


15. 64y” — 48y’ + 17y = 0 
In Exercises 16 through 25 find the solutions of the given initial-value problems. 


16. 2ν" — y’ — 3y = 0; yO) = 2, yO) = --Ὃὦ 
17. γ" — 8y’ + l6y = 0; yO) = 3, YO = -ἰ 
18. ἀν" — 12y’ + 9y = 0; yO) = 1, YO) = F 
19. γ΄ + 2y = 0; yO) = 2, y’@) = 2V2 
20. 4ν" — ἀν’ + Sy = 0; yO) = 3, YO) = 1 
21. γ΄ + ἀν’ + 13y = 0; yO) = 0, γ0) = —2 
22. 9p” — 3γ' — 2y = 0; yO) = 3, γ'(0) = 1 
23. γ" — 2/5 y’ + Sy = 0; γ() = 0, ν΄) = 3 
24. 16y’’ + 8y’ + Sy = 0; yO) = 4, y’CO) = --Ἰ1 
25. γ" — V/2y' + y = 0; yO) = V2, y’'O) = 0 
26. Prove that e“:7 and e%27 are linearly independent in C(— ©, ©) whenever a; and a2 
are distinct real numbers. 


27. Verify that xe®* is a solution of the second-order equation (D — a)*y = 0. Prove 
that this solution and e®? are linearly independent in C(— 0, ~). 
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28. Verify that e** cos bx and e** sin bx are linearly independent solutions of the 
equation 
(ὃ — αὐ)! — αοὴν = 0 


when αἱ = a+ biandag = a — bi,b # 0. 

29. Find a constant coefficient linear differential equation whose general solution is 
(a) (ει + cox)e~3* (b) cye* sin 2x + cge* cos 2x 
(c) (ει + cox)e~2* + 1 (4) cye~? + coe ὅτ + x4 4 
(6) cy sin 3x + c2cos 3x 4+ x/3 

30. For each of the following functions find a second-order linear differential equation 
with constant coefficients which has the given function as a particular solution. 


(a) x(1 + ὁ.) (Ὁ) 4 sin x cos x 
(c) (1 + 2e*)e2* + 6x - 5 (ὦ cos x(1 — 4 sin? x) 
(e) e3t + οἷς: + χροϑε 

31. (a) Show that the general solution of the second-order equation 


[D? — 2aD + (a? + 5*)]y = 0 
can be written in the form 
y = cye** cos (bx + 69), 


1 and ce arbitrary constants. This form is frequently called the phase-amplitude 
form of the solution. Why? 


(b) Write the general solution of (D? + 4)y = 0 in phase-amplitude form. 
32. ΠῚ, = (ὃ — a)’, α real, show that 


le”? = (k — α)" εἰς. 


Differentiate both sides of this identity with respect to & to prove that 


Lxe™” = (k -- a)[2e** + k(k — ae", 


and then show that xe® is a solution of Ly = 0. 
33. (a) Find the solution of 


(D? — 2D + 26)y = 0 


whose graph passes through the point (0, 1) with slope 2. 
(b) Solve the problem given in (a) again, this time writing the general solution in 
the form 
y= fet Ῥ ΓΤ ad 
Evaluate c; and c2 formally, and then use Euler’s formula to show that the resulting 


solution can be transformed into the solution found in (a). 
*34. The function εὖ, z a complex number, is defined by the infinite series 


2 n 


2 ee ee ἘΠ᾽. ἘΠῚ Ἐπ, 
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and it can be shown that this series converges absolutely for all values of z.* Set 


z = ix in this series, and use the fact that 12 = —1 to prove Euler’s formula. 
[Hint: Since the series is absolutely convergent for all z, its terms may be rearranged 
at will.] 


4-3 HOMOGENEOUS EQUATIONS OF ARBITRARY ORDER 


The technique for solving homogeneous constant coefficient linear differential 
equations is now all but complete. For instance, to solve 


(Dt — 2D + 2D? — 2D 4+ ἢν = 0 (4-9) 


we first decompose the operator into linear and quadratic factors, as suggested 
in Section 4-1, to obtain the equivalent equation 


(D — 1)*(D? + Dy = 0, 


and then invoke Lemma 4—1 to assert that the solution space of each of the second- 
order equations (D — 1)?y = 0 and (D? + 1)y = 0 is contained in the solu- 
tion space of (4-9). Thus οὗ, xe”, sin x, and cos x are solutions of (4-9), and since 
these functions are linearly independent in C(—, o), the general solution of 
the given equation is | 


y = (cy + cox)e® + cg sin x + c4 008 x. 


This, in brief, is how all homogeneous constant coefficient equations are solved, 
and save for the difficulty occasioned by equations such as 


(D — 1)*y = 0 
and 
(D? + ὅν = 0, 


where the above argument fails to yield the required number of linearly inde- 
pendent solutions, we are done. But, recalling our experience with the equation 
(D — a)*y = 0, it is not difficult to guess that the missing solutions for the 
above equations are, respectively, χοῦ, x°e*, and x sin x, x cos x. Both of these 
conjectures are correct, and we shall now prove the relevant generalization of 
this fact for arbitrary equations of the form 


(D” + an1D"—) + +++ + ay = 0, (4-10) 
where dg, ..., Gn_, are constants. 
* By definition the absolute value, or modulus, of a complex number z = a + δὶ is 


the real number να + δῇ. A series δ᾽ κ-1 z, Οὗ complex numbers is said to converge 
absolutely if the series >> %—1 |zn| of real numbers converges in the usual sense. 
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We begin by decomposing the operator into linear and quadratic factors, the 
linear factors being determined by the real roots of the auxiliary or characteristic 
equation 

m” + a,_ym™ 1 +--+ + ἀρ = 0, (4-11) 


the quadratic factors by its complex roots. Then, by Lemma 4-1, we can find 
solutions of (4-10) by finding the null space of each factor of the form (D — a)” 
corresponding to the real root a, and of each factor of the form [D? — 2aD + 
(a* + b*)]” corresponding to the pair of complex roots a + bi, b Ὁ. This 
we accomplish in the following theorem, which, it should be noted, also includes 
the case (D — a)? discussed earlier. 


Theorem 4-1. Jf y(x) belongs to the null space of a constant coefficient 
linear differential operator L, then x™~*y(x) belongs to the null space of L”™. 


Proof. To establish this result we must compute the value of the linear differential 
operator L™ applied to the product x”—'y, and we therefore begin by giving a 
formula for evaluating all such expressions. Specifically, if L is any linear dif- 
ferential operator whatever, and if L’, L’’,... denote the formal derivatives of L 
with respect to D,* then 


Law) = (Lu + (’u)Dv + ᾿ (L’'u)D?v + a (L'"u)D*?v +--+ (4-12) 


whenever u and v are functions for which L(wv) is defined.t 
Accepting the validity of (4-12), let L and y(x) be as in the statement of the 
theorem; 1.e., Ly = 0. We must prove that 


χη ἢ = 0. 


To this end we set L” = M, and apply the above formula to obtain 


MOx”—) aid (My)x"—* ae (M'y) Dx —1 ΞΕ 5 (M"y)D?x”"—* ae 


To show that this expression is zero, we first note that D’x”—! = 0 whenever 
r > m. Moreover, when r < μι, the rth formal derivative of M with respect to 
D, M, consists of a sum of terms each of which contains the factor L”™~” (see 
Exercise 20 below). Hence, since Ly = 0 and since L is a constant coefficient 
operator, Lemma 4-1 applies, and we find that My = 0. Thus all of the terms 
in the above expression are zero, and the theorem is proved. J 


* Thus, if L = 3D? + 4D — 1, then L’ = 6D - 4,1 = 6,1." = 0, etc. 

t This formula is really no more than a generalized version of Leibnitz’s formula 
D*(uv) = >oe=0 ()(D*u)(D"—v), introduced in Exercise 15, Section 3-1. Its proof has 
been left as an exercise (see Exercise 18). 
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As a consequence of this theorem we can now assert that the null space of the 
operator (D — a)” contains the functions 


ax ax m—1,ax 
ο΄ We 5 bag ae ε΄΄ 


and that the null space of [D? -- 2aD + (a? + b*)]” contains 


7η,- 


e sin bx, xe sin bx,..., x” 'e® sin bx, 


Ἠὶ 


e"* cos bx, xe cos bx,..., x™ ἱρὰ cos bx. 


And it is out of just such functions that the general solution of every homogeneous 
constant coefficient linear differential equation is constructed. The construction 
depends, of course, upon the fact that the various functions obtained in this way 
are linearly independent in C(— οὐ, 0). They are, but unfortunately there is no 
really brief proof of this assertion. One particularly elegant proof will be given 
in Section 7-7 as an illustration of the ideas introduced there, and in the mean- 
time we will content ourselves with indicating an alternate approach in Example 
5 below. 


EXAMPLE 1. Find the general solution of 
(D? + Ly = 0. (4-13) 


Here the factorization of the operator is (Ὁ + 1)(D? — ὃ + 1), and it follows 
that the roots of the auxiliary equation 


m>+1=0 
are —1, 4 + (/3/2)i, and 4 — (\/3/2)i. Thus the general solution of (4-13) is 
y= cye Ὁ ΞΕ etl2 (c. sin he x + C3 COS _ ; F 
EXAMPLE 2. Solve 
y? — 2y + yO = 0. 


In operator notation this equation becomes 


(Ὁ — 2D° + D*)y = 0, 
and since 
D’ —2p° + D® = ΡἿΩ — 1)0ὼ + 1)’, 


the roots of the auxiliary equation are Ὁ (a root of multiplicity 3), 1 (a root of 
multiplicity 2), —1 (a root of multiplicity 2),* y = cy + Cex + C3x7 + (ce, + 
caxje* + (cg + crx)e ”. 


* The multiplicity of a root a of the equation m"™ + a,_1m™~! +--+ + ao = Ὁ is 
the largest integer k such that (m — a)* is a factor of the operator. 
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EXAMPLE 3. Find a constant coefficient linear differential equation which has 
635 and χε 35 among its solutions. 

In this case we must find a constant coefficient linear differential operator L 
with the property that Le?* = 0 and Lxe~** = 0. (In more picturesque ter- 
minology it is sometimes said that L annihilates these functions.) Clearly any 
operator which contains the factors D — 2 and (D + 3)? will answer the prob- 
lem, and hence 

(Ὁ — 2,0 + 3)?y = 0 


will be an equation of the required type. 
EXAMPLE 4. Find a constant coefficient linear differential operator ZL which, when 
applied to the equation 
(D? + 1)(D — Dy = e® + 2 — 7Txsinx, 
produces the homogeneous equation 
L(D? + 1)(D — Dy = 0. 


Since Z must annihilate the functions e*, 2, and x sin x, it must contain the 
factors D — 1, D, and (D? + 1)”. By Lemma 4-1 we can therefore set 


L = D(D — 1)(D? + 1)”. 


EXAMPLE 5. As our final example we shall prove that the various solutions of 
the equation 
(ὃ — 2)(D + 5)®(D? — 4D + 13)y = 0 


obtained using Theorem 4—1 are linearly independent in C(— οὐ, «). In this case 
the solutions are 


e?* corresponding to the factor D — 2, 


e—°*, χορ ὅς xe 5* corresponding to the factor (D + 5), 


e** cos 3x, 655 sin 3x corresponding to the factor D? — 4D + 13, 


and it is obvious that they are somewhat too numerous to permit their Wronskian 
to be computed easily. Instead we reason as follows: 
Let c1,..., Cg be constants such that 


cye** + (co + 3x + c4x*)e—™ + e7* (cs cos 3x + cg sin 3x) = 0 (4-14) 


for all x. Apply the operator (Ὁ + 5)°(D? — 4D + 13) to this expression to 
annihilate every term but the first, thereby obtaining 


c;(D + 5)°(D? — 4D 4+ 13)e7* = 0. 


But since (Ὁ + 5)°(D? — 4D + 13) does not annihilate e2, it follows that 
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οι = Ο and that (4-14) reduces to 
(co + c3x + c4x*)e~™* + e”*(cs cos 3x + cg sin 3x) = 0. (4-15) 


Next apply the operator (Ὁ + 5)?(D? — 4D + 13) to annihilate every term in 
(4-15) except the one arising from c4x”e~°”. This gives 


c4(D + 5)°(D? — 4D + 13)x7e—°? = 0, 


and since (D + 5)2(D? — 4D + 13)x%e—** is not identically zero, we conclude 
that cz = 0. Hence (4-15) becomes 


(co + cgx)e>” + οἴ (ἐς cos 3x + 66 sin 3x) = 0. 


Continue the argument, using the operators (D + 5)(D? — 4D + 13) and 
D? — 4D + 13 in turn to deduce that cz = 0 and cy = 0. Finally, from the 
identity 

οὕ (ἐς cos 3x + cg sin 3x) = 0 


we conclude directly that c; = cg = 0, and the linear independence of this 
particular set of solutions has been proved. 


In point of fact, this argument can be refined to give a general proof of the 
linear independence of the functions appearing in the solutions of constant coef- 
ficient homogeneous linear differential equations. We refrain from doing so, 
however, since the problem. will be considered in a later chapter where an entirely 
different proof will be given. 


EXERCISES 


Find the general solution of each of the following differential equations. 


1. γ" + 3y” — γ — 3y = 0 2. γ"" + Sy” — By — 12 = 0 
3. 4Ὧγ"" + 12y"" + 9y’ = 0 4, γ΄" + 6y" + 13y' = 0 

5. 2y'” + y” — 8y' — 4y = 0 6.0 By sey a sy 0 

7. yo) — γ᾽ = 0 8. yor) — By" + 16y = 0 

9, yiv) + 18y” + Bly = 0 10. 4ν Ὁ) — 8ν"" — γ" + 2y’ = 0 
11. yliv) + yl" + att = 0 12. γι) = 0 


13. γ(ν) — 4γ"" + 6γ’ -- 4y’ +y =0 14. γι -- 2» γ΄ = 0 

15. y + 6yGv) + 15γν"' + 26γν" + 36y’ + 24y = 0 

16. Find the general solution of (δὲ + ly = 0. 

17. Find linear differential operators which annihilate each of the following functions. 
(a) x2e@tb (Ὁ) 3675 cos 2x 
(c) x(2x + 1)sinx (d) 3 + 4x — 2ε. 2: 
(e) x? sin x cos x (f) x?e* sin? x 


18. 


19. 


20. 


21. 


22, 


23. 


24. 


25. 
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(g) xsin (x + 1) (h) (x? — 1)(cos x + 1)e?* 

ὦ (we? + 133 ὦ @ +e)" 

Use Leibnitz’s formula and mathematical induction to establish (4-12) for any linear 
differential operator L. 

Verify Formula (4-12) when 


(a) L = ἢ 
(b)ZL = D?+2D+1 
(c) L = δ" 


(a) Let P = Q"R, where Q and R are polynomials, and 7 is a positive integer. 
Show that P’ can be written in the form 05 1.5, where S is again a polynomial. 
More generally, prove that if Οὗ divides a polynomial P, then Οὗ’ divides DP. 


(b) Use the result in (a) to prove the assertion made during the proof of Theorem 
4-1 to the effect that Μῶν = 0 whenever r « m. 


(a) Show that the Wronskian of the functions e*17, e*27, ... , e*n™ is 
1 1 1 
ΚΙ Κα pits Te 
οἰ Ἐπ Ἐκ (p22? 
eo τά τως rod 
n 


(b) The determinant appearing in (a) is known as a Vandermonde determinant. 
Prove that every such determinant is nonzero whenever ki,...,n are distinct. 
[Hint: Let V denote the determinant in question, and consider k; as a variable. 
Use an inductive argument to show that for each n, V can be viewed as a polyncmial 
of degree n — 1 in ky which has ko,..., Kn as roots.] 


(c) By direct computation prove that every 3 Χ 3 Vandermonde determinant is 
different from zero if k1, k2, Κα are distinct. 


(d) What conclusion can be drawn about solutions of homogeneous constant co- 
efficient linear differential equations from the results of (a) and (b)? 


Prove that the solutions y1(x), ..., ¥n(x) of a constant coefficient linear differential 
equation are linearly independent in C(— ©, «) if and only if they are linearly 
independent in C(J) for every interval J. [Hint: Assume linear dependence on 7 and 
use the uniqueness theorem.] 


Prove that the functions 625, xe?*, e?* sin x, e2* cos x are linearly independent in 
Θ() for any 7. [Hint: Show that this assertion is equivalent to asserting the linear 
independence of 1, x, sin x, cos x in C(— ©, «) (see Exercise 22), and then study 
the behavior of ει + cox + c3 sin x + cacosxasx— ~.,] 


Establish the linear independence of the functions given in Exercise 23 by applying 


the annihilator of sin x and cos x to the identity εἰ + cox + c3sin x + cacosx=0. 
Prove that the functions e@*, xe®”,..., x”—1!e%*, a real, are linearly independent in 
@(J) for any 1. [Hint: A polynomial of positive degree has only a finite number of 
Zeros. | 
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26. (a) Let P(x) be a polynomial with real coefficients, and let L = P(D) be the asso- 
ciated constant coefficient linear differential operator. Prove that 


Le** = P(aje®’. 


(b) Use the result in (a) to show that for any constant coefficient linear differential 
operator L, Le** = 0 if and only if L has D — a asa factor. 

27. Prove that 

0 ΚΟ μι, 

m(m — 1)... (ἡ -- k + 1)x" “e* if καὶ “ πι. 


In particular, deduce that 


(D ἘΣ a)*x"e** = | 


(D — a)™x™e** = mie. 
28. (a) Let L = (D — a)™(D — 8)", a and β real, a τέ 8. Prove that the functions 


ert xm—igar pbt | xn—lebs 


3 


in the null space of Z are linearly independent in C(/) for any J. [Hint: Apply the 
operators (Ὁ — B)"(D — a)™—1, (Ὁ — B)"(D — a)”~?,...., in succession to the 
identity 


cye™™ $05 + emx™ler® + de® + +++ + ἀ,χη 1685 = 0, 


and use the results of Exercises 26 and 27.] 
(b) Generalize the result in (a) to operators of the form 


L = (D — αὐ)ὸοᾳ τ. (Ὁ -- a) 


where a1, ..., @, are distinct real numbers. 


Remark. The results of the last three exercises, when generalized to include complex 
functions, furnish a proof of the linear independence of the solutions of the equation 
Ly = 0 obtained in this section. 


4-4 NONHOMOGENEOUS EQUATIONS: 
VARIATION OF PARAMETERS AND GREEN’S FUNCTIONS 


In Section 3-2 we observed that the general solution of a nonhomogeneous linear 
differential equation 


αν) G2 ++ $ αρρὺν = A(x) (4-16) 


may be written in the form 
Y= Vp + Vhs (4-17) 


where y, is any particular solution of (4-16), and ys is the general solution of the 
associated homogeneous equation 


an(x) ΤΣ 4 +++ + ao(xdy = 0. (4-18) 


4-4 | NONHOMOGENEOUS EQUATIONS: VARIATION OF PARAMETERS 139 


Using the language of linear operators, the problem of finding a particular solution 
of (4-16)—which we assume defined and normal on an interval J—consists of 
finding exactly one function in @”(J) which satisfies the equation 


Ly = ἢ, (4-19) 


where L is the linear differential operator a,(x)D” + --- + ao(x). And this, as 
we know, is equivalent to the problem of constructing a right inverse for L; mean- 
ing, of course, a linear transformation G: C(/) — eC”(J) such that L(G(h)) =h 
for all hin C(J) (cf., Section 2-5 and Section 3-4). 

The existence of such inverses is guaranteed by the fact that Eq. (4-19) has 
solutions for every h in C(J), and the only open question is how to go about 
selecting a particular inverse for L from the infinitely many that exist. In other 
words, how do we impose conditions on Eq. (4-19) to ensure that it has a unique 
solution for each ἡ in C(/)? When asked in these terms an answer is obvious: 
We simply require that the solution satisfy a “complete” set of initial conditions 
at some point xo in the interval /.* Since the particular solution obtained is quite 
immaterial we choose the simplest of all possible initial conditions, namely 


y(xo) = 0, (xo) = 0,..., ¥™~P(Xo) = 0. (4-20) 


And with this we have in fact defined a right inverse G for the operator L. Speci- 
fically, G can be described as the (linear) mapping from C(/) to Θ᾽) which sends 
each function A in C(/) onto the solution of (4-19) which satisfies the initial con- 
ditions given above. In this section we shall obtain an explicit formula for G in 
terms of a basis for the solution space of the homogeneous equation Ly = 0 
when L is an operator of order two. In the next section these results will be gen- 
eralized to operators of arbitrary order, and once this has been done the study of 
linear differential equations will have been reduced to the homogeneous case. 
(The reader should note that this portion of our discussion is not restricted to 
constant coefficient operators.) 

Thus we begin by considering a normal second-order linear differential equation 


d*y dy = 
ἘΣ + a(x) & + ao(x)y = h(x), (4-21) 
defined on an interval J of the x-axis, and the general solution 


Yr = C1yi(X) + Coye(x) (4-22) 


of its associated homogeneous equation. We seek a particular solution y, of (4-21) 
such that 


Yp(X%o) = 0, γρί(χο) = 9, (4-23) 


where XQ is a fixed but otherwise arbitrary point in J. 


* This requirement can be viewed as restricting the domain of L in such a way that 
L becomes one-to-one and has an inverse. 
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The construction of y, is begun by making the unjustified but not unreasonable 
assumption that any particular solution of (4-21) ought to be related to the ex- 
pression for γμ, and we therefore attempt to alter the latter in such a way that it 
becomes a solution of the given equation. One way of doing this is to allow the 
parameters οι and C2 in (4-22) to vary with x in the hope of finding a solution of 
(4-21) of the form 


Vo = Cy(x)yi(x) + C9(x)yo(x).* (4-24) 


If (4-24) is substituted in (4-21), and the notation simplified by suppressing 
mention of the variable x, we obtain 


cy + ary + aoyi1) + cod + aye + Gove) + (γι + Cayo)’ 
+ ay(ciy: + chyo) + (civ + cby2) = ἢ. (4-25) 


Moreover, since y,; and yg are solutions of the homogeneous equation γ΄ + 
ayy’ + apy = 0, the first two terms in (4-25) vanish, and we have 


(ciyi1 + caye)’ + ar(ciys + cye) + (ciyi + coya) = ἢ. 
This identity, which must hold if (4-24) is to be a solution of (4-21), will obviously 
be satisfied if c; and cz can be chosen so that 
ch(x)yi(x) + cox)ye(x) = 9, 
ci(x)yi(x) + co(x)ya(x) = hQ), 


for all x in 1. Thus it remains to show that these equations serve to determine 
c,(x) and c.(x), and that this can be done in such a way that the function 


(4-26) 


Vp = C1(x)yi(x) + Co(x)yo(x) 
satisfies the initial conditions given 1n (4-23). 
But, for each x in J, (4-26) may be viewed as a pair of linear equations in the 
unknowns c;(x) and c3(x). As such, the determinant of its coefficients is 
yi(x) yo(x) 


γι) γ2(.) 


3 


which we recognize as the Wronskian of the linearly independent solutions γ1(Χ) 
and y2(x) of the homogeneous equation associated with (4-21). We now recall 
(Theorem 3-6) that this determinant is a continuous function of x which never 
vanishes on I. Hence (4~26) has a unique solution for c;(x) and c9(x), and, once 
this solution is known, c,(x) and c2(x) can be found by integration. Moreover, by 


* The term “‘parameter” is frequently used as a synonym for “constant,” particularly 
when, as in this case, the constant is allowed to assume arbitrary values. 
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suitably choosing the limits of integration, the required initial conditions can also 
be satisfied, and the argument is complete. For obvious reasons, this method of 
constructing a particular solution for a nonhomogeneous linear differential equa- 
tion out of the general solution of its associated homogeneous equation is known 
as the method of variation of parameters. 

Starting with (4-26), an easy calculation gives 


roy — — __AOD2) roy — ἄχ) 
40) = τ Wiy.00), yl 0) = Why), yO] 
Thus 


_ [aya _ h(dy(1) 
a= —] wo γε °° = J, Wire (20 


and if these values are substituted in (4-24), and terms combined, we find that 
Yp can be written in integral form as 


— [ἢ γωοσ)νι -- για)νε(ῦ 
Yo(x) = . νι, γί] (αἱ ὑπ 58) 


One reason for calling attention to this expression is that it can be read as the 
definition of a right inverse for the linear differential operator L = D? + 
a,(x)D + ao(x), and, in fact, is the particular right inverse discussed earlier in 
this section. For if ἢ is any function in C(J), and if we set 


G(h) = | K(x, t)h(t) dt, (4-29) 
where 
_ yalx)yilt) — yil)y2) , 
Κα, ἢ = Wind, v2 {τ} 


then G maps @(/) to 6 (1). acts as a right inverse for L, and has the further prop- 
erty that G(h) satisfies the initial conditions G(h)(xo) = G(h)'(xo) = 0 (See 
Exercise 29). It should be pointed out that the function K(x, ἢ) defined by (4-30) 
is independent of the particular choice of x» in the interval 7, and is completely 
determined by the operator L.* As such it is referred to as the Green’s function 
for L for initial value problems on the internal I, or, more simply, as the Green’s 
function for L. 


EXAMPLE 1. Find the general solution of the second-order equation 


y’ + y = tanx. (4-31) 


* In the next section it will be shown that K(x, ἢ) is 4150 independent of the particular 
basis chosen for the solution space of Ly = 0. 
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In this case the associated homogeneous equation has 
Yr = σι SIN xX + CQCOSX 
as its general solution. Thus we seek a particular solution of (4~31) in the form 
Vo = €3(x) sin xX + Co(x) cos x, 
where c,(x) and co(x) are determined from the pair of equations 


ci(x) sin x + co(x)cos x = 0, 
c4(x) cos x — c(x)sinx = tanx 
(see Eq. 4-26). This gives 
ci(x) = sin x, 
ch(x) = —sin x tan x, 
and it follows that 


C1(x) = J sin x ax = —COS xX, 


. 2 
sin” x 
Cc ἘΞ, "ἘΞ dx = — | (se — cos 
2(x) i x fc cx — cos x)dx 
= —In|sec x + tan x| + sin x." 
Thus 
Yop = —cosxsinx + [sin x — In |sec x + tan x|]cos x 


= —cos x In |sec x + tan |, 
and the general solution of (4-31) is 
y = —cos xIn |sec x + tan x| + cy sin x + C2 008 x. 


An alternate method of solving (4-31) relies upon determining the Green’s 
function K(x, ἢ) for the operator L = D? + 1. According to (4-30) 


sin x cost — cosxsint 


K(x, ἢ = Wicos t, sin ἢ 


= sin (x — ἢ), 


and if we set Xx) = 0 in (4-29), the expression 


G(h) = [ sin (x -- ἡ)λ(ῦ dt 


defines a right inverse for L. (The reader should note that at this point we are in 
a position to solve ail linear differential equations involving D® + 1, a fact which 


* It is standard practice to omit the constants of integration at this point since without 
them we still obtain a particular solution of the given equation. 
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vividly illustrates the economy of using Green’s functions.) It now follows that a 
particular solution of (4-31) can be obtained by applying G to the function tan x; 
1.e., by computing 
p(x) = | sin (x — ft) tan ¢ dt. (4-32) 
0 
This gives | 


a 
Vp(x) | (sin x cos t — cos x sin t) tan ¢ dt 
0 


° ” sin? t 
: : i 
sin x| sin t dt — cos | at 
0 0 cost 


Ϊ 


= sin x — cos x In |sec x + tan x]. 
EXAMPLE 2. In Section 4-8 we will show that the general solution of 
xy +y¥ = 0 
on (0, 0) and (— 0, 0) is cy + c2In |x|. Hence the nonhomogeneous equation 
xy" +y=xt1 (4-33) 


has a particular solution of the form yy, = c,(x) + c2(x) In |x|, where c,(x) and 
C(x) are determined from the equations 


A(x) + (x) In αἱ 


0, 


x+1, 
XxX 


1 
C2(x) - ᾿ 


[Here h(x) = (x + 1)/x since we must divide by x to put (4-33) in normal form.] 
Thus 
ci(x) = —@ + 1) In [xI, 


co(x) = x + 1, 
and 


This gives 
2 2 2 2 
sat χα Tele ibd he alae he 


and the general solution of (4-33) is 


χϑ 
Yr  Ὑ ΧῈ σε + cgi |x]. 
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EXERCISES 


Find the general solution of each of the following differential equations. 


1. 
3. 


5. 


7. 


9. 


1 τῶν. 
(D° + Dy = —— 2. (Ὁ — D— ὃν = e ’sinx 
(D? + 4D + 4)y = xe”* 4. (D? + 3D — dy = xe” 
22 
(4D? + 4D + τὴν = xe?! sin x 6. (D? + 4)y = > 
2. 2 

1 : 
(05 + 10D -- 12)y = Ὁ εἰ 8. (D + ἦν = (x + De 
(D" -, 2D+ 2)y = εἶ sin x 10. (4D” --Ῥ 80)- 5)» =e tan” : 


2 


For each of the following differential equations verify that the given expression is the 
general solution of the associated homogeneous equation and then find a particular 
solution of the equation. 


. x2y" — 2χγ' + 2y = χϑίηχ, x > 0; ya = εἰχ + Cox? 
. χγ" — xy + y = x(x + 1); yr = (ει + co In |x|)x 


(sin 4χ)γν" — 4(cos? 2x)y’ = tan x; Yr = σι + €2 08 2x 


xy” — (1 + 2x?)y’ = χϑρ:"; γι = ει + c2e*” 


(1 — x*)y’ — 2xy’ = 2x, -1l <x <1; γι = er + coin τ 
| — x 


In each of the following exercises find a Green’s function for the given linear differential 


operator. 

16. D2 + 3 17. D2? -- D—2 
18. D2? +4D+44 19. 4D? — 8D -- 5 
20. D2? 3} -- 4 21. x2D2 — 2xD + 2 
22. xD? — (1 + 2x)D 23. (1 — ΧὩ) — 2xD 


24. 


25. 


26. 


Solve the initial value problem 
(D2 + 2aD + δὴν = sin ot, y(0) = y’O) = 0, 
where a, b, w are (real) constants, a < δ. Consider separately the cases 


w ~ /b2 — a2andw = Vb2 — a2, and sketch the solution curve in each case. 


Find a Green’s function for the operator in Exercise 24, and use this function to 
obtain the desired solution as G(sin w/). 


The second-order equation 
(D — 1)D + 3)y = εὖ 
may be solved by setting (xD + 3)y = u, and then successively solving the first-order 


equations 
(D — 1)u = e* and (xD + 3)y = ua. 


Use this technique to show that the general solution of this equation is © 


_ C1 , C2 oe 2 
Pa as (x 2x+2)+e. 
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27. Use the technique introduced in the preceding exercise to show once more that xe%* 
is a solution of (D — a)?y = 0. 

28. Let K(x, ἢ) denote the Green’s function (4-30) for initial value problems involving the 
operator L = D? + ai(x)D + ao(x), and assume that L is defined on an interval J 
of the x-axis. 
(a) What is the domain of K(x, ὃ) in the xt-plane? 
(Ὁ) Prove that K(x, x) = 0 and K,(x, x) = 1 for all xin 71. [Note: K,, denotes the 
partial derivative of K(x, ἢ) with respect to x.] 
(c) Show that for each fixed ¢ in J the function g(x) = K(x, ὃ) is a solution on 7 of 
the initial value problem Ly = 0; y(t) = 0, φ'(ὃ = 1. 
(d) Use the results of (b) and (c) to deduce that K(x, 2) 15 independent of the particular 
basis y1(x) and yo(x) chosen for the solution space of the homogeneous equation 
Ly = 0. 

29. With K(x, ἢ) as in the preceding exercise, show that the function y, defined by 


y(x) = | K(x, t)A(t) at 


satisfies the initial conditions y,(xo) = y,(xo) = 0 for all A in CW). [Hint: Use 
Leibnitz’s formula for differentiating integrals,t namely, 


b(x) b(z) 


ΚΙ FG Ndi πὶ fl αι + f(x, δ») Ὁ) -- F(x, αρ))α"Ὁ)] 


dx a(x 


*30. Find the Green’s function for initial value problems on (0, ©) for the operator 


2 
b= o+to+(i-%), 
x x2 


p a non-negative real number. 


*4-5 VARIATION OF PARAMETERS; GREEN’S FUNCTIONS (continued) 


The method of variation of parameters can easily be extended to equations of 
arbitrary order. In this case we begin with a normal equation 


Vb ας το)" po -Ὁ ἀροῦν = h(x) (4-34) 
defined on an interval J, and again assume that the general solution 
Yh = CV i(X) +++ + CnYn(X) (4-35) 


of the associated homogeneous equation is known. Then, following the argument 
given in the second-order case, we seek a particular solution of the form 


Vo = ςχ(χ)ν(Χ) + + + Ca) yn), (4-36) 


Τ See Theorem I-36. 
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where, in addition to the requirement that y, satisfy (4-34), we impose the follow- 
ing 2 — 1 conditions on the unknown functions c,(x), ..., ¢n(x): 


Ciyi t+ + hyn = 9, 


cys tees + cay (4-37) 


Ι 
oe © 


—2 —2 : 
chy? + τ. + chy? = 0 


for all xin 1. If the expression for y, is now substituted in (4-34) and the above 
conditions are used, we obtain the additional equation 


δῦ foes -Ὁ chy = Alen), (4-38) 


and, for each x in J, (4-37) and (4-38) may be viewed as a system of n linear 
equations in the unknowns cj, ..., c, whose determinant is W[y (x), ... , yn(x)]. 
Our earlier reasoning still applies, and we can obtain a particular solution for 
(4-34) by solving this system for cj,...,¢,, integrating, and then substituting 
the resulting functions in (4-36). 

In fact, if V;,(x) denotes the determinant obtained from W[y,(x),..., yn(X)] 
by replacing its Ath column with 


0 
0 


then a straightforward computation gives 


bo) = VA) 
OO) = Οὗ -- yO) 


(See Exercise 17.) Hence, just as in the second-order case, the particular solution 
may be written in integral form as 


(4-39) 


[νιν -Ὁ ---  γκαὴ)νκ(ὺ 
ele) = a ἤπια 8 ee 


where Xo 15 any point in J, or as 


yp(x) = / K(x, th(t) dt, (4-41) 
where : | 


γι) (ἢ + 22 + nV 
ee iO NMC) oa 
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or, for the reader who prefers determinant notation, 


yilt) τς γρμ() 

yi) ἡ ἐς γκ(ὴ 

yP2(2) vee γι τ 
K(x, t) = Iyi@) “τ᾿ γα) ᾿᾿ (4-43) 
Ce Co ae 

yi) ἐστ Y(t) 


Oe a) 
nO ee ae 


The function K(x, t) defined here is called the Green’s function for the operator 
L= D" + a,_\(x)D"~! +--+ + ao(x) (for initial value problems in the 
interval 7), and the expression 


G(h) = | K(x, t)h(t) dt (4-44) 


defines a right inverse G: C(/) — @”(/) for the operator L. In fact, G is the inverse 
for L such that G(A) satisfies the initial conditions 


G(h)(X0) = G(h)'(Xo) = --- = GAY? (xo) = 0 (4-45) 
for all ἃ in C(J/). 
EXAMPLE. Find a particular solution y, for the equation 
3y'"” + Sy” — 2y’ = r(x), (4-46) 
r(x) continuous on (— οὐ, 0). 
Here the general solution of the associated homogeneous equation is c, + 
coe δ + c3e7/3. Hence 


Yp = €4(x) + ca(xje~** + ca(x)e”®, 


where c)(X), Co(x), c3(x) satisfy the identities 


ch(x) + co(x)e~?” + c4(x)e7/* = 0, 
—2ch(x)e~** + ες)" = 


Θ 


dch(x)e™* + ἐοιλο5 = 199. 
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Thus 


a(x) = — 9, 


2 
c2(x) = qge""r(x), 


1 
c4(x) = #e~7/*7(x), 
and it follows that 


—22 2/3 
Yo = - | r(x) dx + 7 / e**r(x) dx + cl / e~*'°r(x) dx 


/ [- + το στὸ 4 Bel 9/37) dt. 


Alternately, we could have computed the Green’s function K(x, ἢ) for the (nor- 
mal) operator δ + §D? — 2D, and used (4-41) to express y, as an integral in- 
volving K(x, ἢ. Starting with the basis 1, ὁ 25, e*/? for the solution space of the 
associated homogeneous equation, we then obtain 


] et οἱ 3 
ὃ .-2 6: Ὁ 1,18 
1 | as ον 18 
K(x, ἢ = ΞΞΞ τ 
0 = Jet 1.1.8 
0 4e—?! 1.13 
τ on" ΗΒ 1,35 ,118 .- γρ5|8,. 2! 


—5t/3 —5t/3 
—e — te 


»τοίῷ 


μ᾽ 
| [-- Ὁ τὸ + 3e—9/31(2) dt, 
Zo 


3 3 —2(x—1t) 9 (“--) 8 
Τ 2 145 , 9 οἱ " . 


which agrees with the result obtained above. 


The remainder of this section will be devoted to taking a closer look at the Green’s 
functions for initial-value problems, and to establishing some of their more im- 
portant properties. Throughout this discussion we shall assume that 


L= D® + a,_i0)D" 1 +--+ + ao(x) 


is a fixed linear differential operator on @”(/), and that K(x, ἢ is the function 
obtained above from the general solution of the equation Ly = 0. It then follows 
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from the very way in which K(x, ἢ was constructed (see Exercises 18-2} below) 
that 
(1) K(x, ὃ) is defined throughout the region R of the xt-plane consisting of all 
points (x, ἢ with x and ¢ in J (see Fig. 4-1); 
(2) K(x, t) and 0dK/ax, 8?K/dx?,..., t 
6 Κι) 8χ" are continuous everywhere in R; _ 
(3) For every Xo in I, and every ἢ in C(J), 
the function 


y(x) = [ “Κα, ὑκ(ὺ dt 


is a solution of the initial-value problem 
Ly - ἢ; 
γα ο) = γα) = τ" = γι σοῦ = 0 


FIGURE 4~1 


on I. 

These properties are actually sufficient to characterize the Green’s function for 
initial-value problems involving L in the sense that K(x, t) is the unique function 
defined in R which satisfies (1), (2), and (3). This assertion will be proved below 
as Theorem 4-3, and is mentioned here only to motivate the following definition. 


Definition 4-1. A function H(x, ἢ) is said to be a Green’s function for initial 
value problems involving the linear differential operator L if and only if 
H(x, ἢ enjoys the three properties listed above for the function K(x, ὃ. 


This said, we proceed at once to give an alternate, and for our purposes much 
more useful description of a Green’s function for L. For convenience, we shall 
denote the various derivatives 0H/dx, 0*H/dx?,... appearing in the following 
argument by #,, Ho,.... And with this notation in effect, we have 


Theorem 4-2. Let H(x, ἢ be defined throughout the region R described 
above, and suppose that H and its partial derivatives H,, H»,..., Hn are 
continuous everywhere in R. Then H(x, t) is a Green’s function for the linear 
differential operator L = D” + ajn_y(x)D"—* + +--+ + ag(x) if and only 
if the following identities are satisfied throughout R: 


A(x, x) = 0, 
Hy (x, x) = 0, 
: (4-47) 
Hy _2(x, x) = 0, 


A, —1(x, x) = Ι, 
and 


H,(x, t) ale An—1(X)Hn_1(x, t) 5 hae ao(x)H(x, t) = 0. (4-48) 
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Proof. First assume that H(x, ἢ) is a Green’s function for L. Then, by definition, 
the function 


y(x) = [ ᾿ H(x, ὑκ(ὺ at (4-49) 
is a solution of the initial value problem 
Ly = hs γαὼ = ¥'(x0) = +++ = YY (Xo) = 0 
for every Xo in J, and every h in C(/); see (3) above. We now differentiate (4—49) 
using Leibnitz’s formula* to obtain 
ya) = f Hy, (x, t)h(t) dt + H(x, x)h(x), (4-50) 


which reduces to 
H(Xo, Xo)h(Xo) = 9 


when x = Xo (recall that y’(x9) = 0). But, by assumption, this expression is 
valid for all ἢ in C(/), and hence, in particular, for ἢ = 1. Thus H(xo, xo) = 0, 
and since χρ can be chosen arbitrarily in J, we have 


A(x, x) = 0, © 
and 


y(x) = [ Ἧι, dat) dt. (4-51) 


We now repeat the argument, starting with (4-51), to get, first 


yx) = [ “150, t)h(t) dt + Hy(x, x)h(x), 


then 
H (x, x) = 0, 
and finally 


yx) = [ ” Ho(x, t)h(t) dt. 


Continuing in this fashion we eventually arrive at the situation 


Η,--«(α, x) ΞΞ 0, 
and 


yx) = [ Hy _1(x, DA?) dt. 
ed |) 
* Leibnitz’s formula is 


b(x) b(x) 
- f(x, tdt = | OF (x, dx + f(x, δ) "Οὐ — F(x, alx))a'(x). 
dx a(z) a(z) Ox 
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Differentiating once more, we obtain 


yo) = | ” Hy(x, h(t) dt + Hy_(x, h(x), 
whence : 
y™(x9) = H(xo, xo)h(X0). (4-52) 


But since y(x) is a solution of Ly = ἡ, 
YX) + andy P(X) +++ + ao) = hQ), 
and the initial conditions in effect imply that 


γα ο) = A(Xo). 


This, together with (4-52) and the fact that A and xp are still arbitrary, implies 
that 

Η,- τ(χ, x) = Ι, 
and 


yx) = [ ” Hy (x, t)h(t) dt + h(x). 


Thus, in particular, we have established the several identities listed in (4—47). 
To prove (4-48) we substitute the formulas obtained above for y, y’,..., p"—P 
in Ly = h. After the various terms are collected we have 


[ * THn(% ὃ) + ας. ἸΟῪ, α(α, Ὁ - --- + ἀρ) ῇᾳ,, DAD dt =0, (4-53) 


and the fact that this expression holds for all x9 in J and all hin Θ(7) allows us 
to conclude that the bracketed portion of the integrand is identically zero (see 
Exercise 23). And with this, the first part of the proof is complete. 

As for the remainder, the argument needed to show that (4-47) and (4—48) 
imply that H(x, t) is a Green’s function for LZ is an even more elementary com- 
putation than the one just given, and has therefore been relegated to the exercises 
(see Exercise 24). J 


Among other things, this theorem asserts that for any fixed fo in the interval 7, 
the function 


k(x) = H(x, to) 
is a solution of the initial-value problem 
Ly =0; = (to) = Y(to) = + = VY"? (to) = 0, γῆ ὕω = 1. 


But, as we know, the solution of this problem is unique. Thus the values of 
H(x, t) are uniquely determined by the operator L on the line segment consisting 


152 EQUATIONS WITH CONSTANT COEFFICIENTS | CHAP. 4 


of those points (x, f)in R with t = fo (see Fig. 4-2). However, ἐρ can be chosen 
arbitrarily in 7. and we therefore have our main result. 


Theorem 4-3. The Green’s function for initial value problems on I involving a 
linear differential operator L is uniquely determined by L, and hence must 
coincide with the function K(x, t) defined by (4-42) or (4-43). In particular, 
K(x, t) is independent of the basis for the solution space of Ly = 0 used in 
computing it. 


FIGURE 4-2 


Everything that has been said up to this point in our discussion applies to 
arbitrary linear differential operators. As might be expected, much more precise 
information can be given in the case of operators with constant coefficients, and 
we conclude this section with a theorem which describes the Green’s functions 
obtained in this special case. 


Theorem 4-4. The Green’s function for a constant coefficient linear differen- 
tial operator L can be written in the form k(x — t), where k(x) is the solution 
on (— «, «) of the initial value problem 


Ly=0; y0) = YO) - --- = » 50 = 0, y*™" PO) = 1. 


Proof. The function H(x, t) = k(x — ἢ clearly satisfies the identities (4-47) and 
(448) of Theorem 4-2, and hence, by Theorem 4-3, is the Green’s function for L.* ἢ 


EXERCISES 


Use the method of variation of parameters (without employing Formulas (4-41) through 
(4-43)) to find the general solution of each of the following differential equations. 


1. yy” — γ’ — yp’ + y = 4xe* 2. y" — y’ = sinx 
3. γ""" — 2y” = 4 - 1) 4. yy" —3y" —y +3y=1+e 


* Note that the assumption of constant coefficients is needed to verify (4-48); see 
Exercise 25. 
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5. γ᾽" — Ty’ + ὃν = 2sinx 6. γ΄" — 3y’ — 2y = Ye 
7. yy" — y’ = sinx 8. y+ yp’ + y + y = Asin x + cos x) 
9, yGv) — y!” = 2xe? 10. yo) — y = χ 4] 


In Exercises 11 through 16 compute the Green’s function K(x, ἢ) for the given operator 
(a) by using Formula (4-42) or (4-43) and (Ὁ) by applying Theorem 4-4. 


11. δ: — 1) 12. D(D? — 4) 
13. D? — 602 + 11D — 6 14. 038 + 503 — 8 
15. D2(D2 -- 1) 16. D* --Ἰ 


17. Verify Formula (4--39). [Hint: Use Cramer’s rule.] 
Exercises 18 through 21 concern properties of the function K(x, ἢ defined by Formula 
(4-42) or (4-43). Establish each of them. 
18. When n = 2, Formula (4—43) reduces to (4—30) of the preceding section. 
19. K(x, t) is defined and has continuous derivatives through order n in the region R 
described in the text. 
20. The partial derivatives with respect to x of K(x, ft) satisfy the identities 
K(x, x) = Kit, x) Se nes n—2(X, x) = 0, K,—1(x, x) = 1, 


in the interval 7. Here 


a 


ὃ 
Κια, t) = δχὶ 


21. For each xo in J and each ᾧ in Θ(ἢ) the function 


K(x, ὃ. 


y(x) = [ “Κα, t)h(t) αἱ 


satisfies the initial conditions y(xo) = --- = γ΄ (ΧΟ) = 0 and the equation 
Ly = h(x). [{Hint: Use Leibnitz’s formula and the result of Exercise 20.] 
22. If f(x) is continuous on the interval [a, δ] and if 


[ ” Pade(x)dx = 0 


for every g in C[a, δ], then f= 0 on [a, 6]. [Hint: Assume f(xo) ~ 0 and use the 
continuity of f to obtain an interval (xo — ὃ, xo + δ) in which | f(x)| >| f(xo)|/2. 
Then find a function g in C(J) for which the above integral is different from zero.] 


23. Use the result of Exercise 22 to prove the assertion made in the text concerning the 
bracketed term in (4-53). 


24. Let H(x, ἢ satisfy the hypotheses of Theorem 4-2, and the identities given in (4-47) 
and (4-48). Prove that for every xo in J and every A in C(J) the function 


y(x) = [ ” Hx, ἡμ( αἱ 


satisfies the initial value problem 
Ly =0; γΟῦο) = y’(xo) = +++ = γῦ Y(x0) = 0. 


(Hint: Use Leibnitz’s formula.] 
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25. Show that the function H(x, ἢ) = k(x — ὃ appearing in the proof of Theorem 4—4 
satisfies (4-47) and (4-48). 


The only values of K(x, ἢ) which enter into the integration in (4—44) are those for which 
the point (x, ἢ) lies in the subregion R,, of R shaded in Fig. 4-3. This suggests the possi- 
bility of generalizing the notion of a Green’s function as follows: 


t 


Definition 4-2. A function K(x, ὃ is 
called a Green’s function for the operator 
L= Dp” | An—1(x)D*—} Ἔ τ: tb ao(x) 
for initial value problems at the point xo 
if it is defined and continuous in R,,, 
and if for every ἢ in C(J the function 


y(x) = [ “Κα, HACE) αἱ 


is the solution of the initial value problem 
Ly =h; 
y(xo) = °°: = y*-Y(Xo) = 0. FIGURE 4-3 


In the exercises which follow we explore some of the properties of these functions, and, 
in particular, show that under certain additional assumptions they coincide with K(x, ἢ. 
26. Let K(x, ἢ be as described above, and assume that L = D? + aj(x)D + ao(x). 
Suppose, in addition, that 
(i) K(x, ὃ, Ki(x, ὃ, Ke(x, ὃ are continuous in R,,, 
(ii) K(x, x) = 0o0n /, 
(iii) K(x, x) = lonl. 
Prove that 
Ko(x, ἢ + ai(x)Ki(x, ὃ + ao()K(, ἢ = 0. 


[Hint: Follow the proof of Theorem 4—2.] 

27. Let K(x, ἢ be as described in Exercise 26. Prove that K(x, ὃ = K(x, ὃ in the 
region R,,,. 

28. Generalize the results of Exercises 26 and 27 to the nth-order case. 


4-6 REDUCTION OF ORDER 


One of the remarkable properties of linear differential equations is that we can 
simplify (and sometimes solve) the equation Ly = h even when we do not have a 
complete basis for the solution space of Ly = 0. Again the technique is variation 
of parameters, but this time it leads to a reduction in the order of the equation. 


The following example will serve to introduce the method. 


EXAMPLE 1. Consider the second-order equation 


2 
x? ον + x? % — 21 + x*)y = x (4-54) 
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on the interval (0, o). Here none of our earlier techniques 15 sufficient to obtain 
the general solution of the associated homogeneous equation 


eee 4 oY _ 211 + x)y = 0. (4-55) 


However, the solution y = x? of (4-55) is easily discovered by inspection,* and 
we now proceed to seek solutions of (4~54) in the form 


y = xe(x). 
Then 
y = x*c'(x) + 2xc(x), 
γ' = x*c"(x) + 4xc’(x) + 2c(x), 


and (4—54) yields 
x?(x2e" + 4xc’ + 2c) + x3(x2c’ + 2xc) — 2(1 + x?)x2e = x, 
which, upon simplification, becomes 


x*c" + (4x? + x Jc! = x, 
or 


4 Ἢ x? l 
δ 4+ —— c= aac (4-56) 
But (4-56) may be viewed as a first-order equation in c’, and as such can be solved 
by the technique introduced in Section 3-3. Indeed, using the integrating factor 


2 2 
ol (A+e )/x dx 44% 2 


=e 
we obtain 


= [Κι Ἔ [ xe” 12 dx| oer 


4 +- οἷ Ἵ2χ ἄς --τ 21/2 


= - + kyx te? 
where k, is an arbitrary constant. Hence 
c(x) = ~ a5 + Κι |. "ἐπ᾿ to. 
where kz is also arbitrary, and it follows that 
y = x*e(x) = ᾿ + kyx? [.--“- Ὁ dx + Καχ' 


* The phrase “discovered by inspection’”’ is just a dodge to hide the fact that the process 
was one of trial and error. 
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is a solution of (4-54). In fact, since x? and x? fx~4e—*/? dx are linearly in- 
dependent in C(O, oo), this expression is actually the general solution of (4-54) 
on the interval (0, 0). 


The preceding example is representative of the technique whereby the order of 
a linear differential equation can be reduced by one as soon as a single (nontrivial) 
solution of its associated homogeneous equation is known. To establish this 
assertion in general, let Ly = h be an equation of order n, and suppose that 
u(x) 15 a nontrivial solution of Ly = 0. Then, evaluating the left-hand side of : 
the expression L[u(x)c(x)] = h(x) by means of Formula (4-12), we obtain | 


(Giese ᾿ Cpe haved ΕΗ (Lue = h. (4 57) 


But since Lu = 0, the first term in this equation vanishes, and we may therefore 
view (4-57) as a linear equation of order n — 1 inc’. This is the asserted reduc- 
tion in order. In particular, this technique can always be used as it was above 
to find the general solution of a second-order equation whenever one nontrivial 
solution of its associated homogeneous equation 1s known. 


EXAMPLE 2. The second-order equation 
(D — a)?y = 0 | (4-58) 


has 65 as a solution. Using the above technique to find the general solution we 
set 
y = e(xje™, 


substitute in the equation, and obtain 
ce + Jacle™ + a2ce®® — 2a(c’e** + ace®*) + a*ce%* = 0. 


This simplifies to c’’ = 0, which, by two integrations gives 


c= Κιχ Ἤ Ko. 
Thus 
y = (kyx + Kaje™, 
as expected. 
EXERCISES 


In Exercises 1 through 6, find the general solution of each differential equation using the 
given solution of the associated homogeneous equation. 
1. y” + xy’ = 3x, 1 2. xy’ — (x -- 2)ν' + 2ν = x8 4+ x, οξ 
3, xy’ — γ = 0, 1 4. χγ' τ 2+ χ)γ ty =e", I/x 


5. 
7. 


το. 


10. 
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4x2y"’ — 8xy’ + Dy = 0, x2/? 6. xy’? + (x — Dy’ —y =0, ε΄ 
Starting with the solution y = e—J'%0(#/e,@l¢dz of the normal first-order equation 


d 
ay(x) = + ao(x)y = 0, 


use the method of reduction of order to find the general solution of 


a\(x) 2 + ao(x)y = A(X). 


. The second-order equation 


( — x?)y’” — 2xy’ + 2y = 0 


has y = x as a particular solution. Use the method of variation of parameters to 
reduce the order of this equation, and then find a second linearly independent solution 
in each of the intervals (—«, —1), (—1, 1), (1, ©) in which the equation is normal. 


It can be shown that the equation* 
xy” + y + xy = 0 
has a solution, Jo(x), on the interval (0, ©) which can be expanded in a power series as 


2 4 
x x® 


x 
— 92+ 2442)2 26(3ὴ2 


Find a second solution, linearly independent of Jo(x) in C(O, ©), of the form 


Jo(x) = 1 cae 


dx 
Jo(x) = [ as 
06) = ᾿ ΟΡ 
and then prove that this solution can be written in the form 
Jo(x) In x + (power series in x). 


What is the behavior of this solution as x — 0? 


Let y; and y2 be linearly independent solutions of a normal third-order homogeneous 
linear differential equation Ly = 0 on an interval J, and let My = 0 be the second- 
order equation obtained by using the solution y; to reduce the order of Ly = 0 by 
one. Prove that (y2/y1)’ is a solution of My = 0 on any subinterval of 7 in which 
y1 has no zeros. 


4-7 THE METHOD OF UNDETERMINED COEFFICIENTS 


The method of variation of parameters enables us to find a particular solution of 
a nonhomogeneous linear differential equation whenever the general solution of 
its associated homogeneous equation is known. However, it is not always the 


* This equation is known as Bessel’s equation of order zero and will be studied in detail 
in Chapter 15. 
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most efficient way of producing such a solution, and for certain equations the 
work involved can be considerably lightened. For instance, it would be pointless 
to use variation of parameters to find a particular solution of (D? — D + 5)y = 3 
since the solution y, = # 15 immediately evident. And even for an equation 
such as 

(D? + 3)y = οἷ 


it is obvious that a solution of the form 
Vp = Ae’ 


must exist for a suitable value of A. Moreover, by substituting Ae* in the equation 
we obtain 


from which it follows that A = 4, and y, = 67,4. 

This method, wherein a particular solution is known up to certain undetermined 
constants, and the values of these constants are found by using the differential 
equation, is known as the method of undetermined coefficients. It is clear that this 
method depends for its success upon the ability to recognize the form of a par- 
ticular solution, and for this reason lacks the generality possessed by the method 
of variation of parameters. Nevertheless, it can be used often enough to merit 
some attention. 

One type of equation for which this method always works is a constant coef- 
ficient equation 

Ly =h (4-59) 


in which ἃ itself is a solution of a linear differential equation with constant co- 
efficients. For then we can find a linear differential operator L, which annihilates 
h (i.e., such that L,h = 0), and it follows that every solution of (4-59) is also a 
solution of the homogeneous equation 


L,Ly = 0. (4-60) 


Thus we can obtain a particular solution for (4-59) by appropriately determining 
the constants in the general solution of (4-60). A few examples will suffice to 
illustrate this technique. 


EXAMPLE 1. Since D® annihilates the right-hand side of the equation 
(D? + ly = 3x? + 4, (4-61) 


a particular solution of (4-61) can be found among the solutions of the homo- 
geneous equation 
D*(D? + ly = 0. (4-62) 
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In other words, (4-61) has a particular solution of the form 


Vp = οἱ + Cox + c3x” + cq sin x + C5 COS x (4-63) 


for suitable values of c1,...,¢Cs5. In fact, we can say even more than this if we 
observe that c4sinx + c;cosx is the general solution of the homogeneous 
equation (D? + 1)y = 0. For then it is clear that the last two terms in (4-63) 
will be annihilated when substituted in (4-61), and so, rather than mindlessly 
dragging them through our computations only to see them disappear in the 
process, we can begin by setting 


Vp = Cy + Cox + €3x?. 
Substituting this expression in (4-61) we obtain 
2c3 +e, + Cox + c3x? = 3x? + 4, 
from which it follows that _ 
Ci + 2c3 = 4, Co = 0, C3 = 3. 
Thus c; = —2, Cc. = 0,c¢3 = 3, and 
»ρ = 3x? — 2. 
EXAMPLE 2. To find a particular solution of 
(D? — 4D + 4)y = 2655 + cos x, (4-64) 
we apply the operator (Ὁ — 2)(D? + 1) to the equation and obtain 
(D — 2)°(D? + ly = 0. 
The general solution of this last equation is 
y = cye?* + coxe?® + c3x7e?* + cg sin x + cs COS x, 


and since the first two terms are annihilated by the operator D? — 4D + 4, we 
look for a particular solution of (4-64) of the form 

Vp = C€3x%e7* + c4sinx + Cs cos x. 
In this case 


2 . 
2c3xe?” + 2c3x7e?* + cycosx — Cs sin x, 


͵ 
» 
᾿-. 2 2x 8 2x 4 2 22 . 
Vo = 2c3e"° + δορχο + 4c3x"e~™ — C4 SIN χ — C5 COS X, 


and substitution in (4—64) yields 


2coe”* + (3c4 + 4c5) sin x + (3c® — 4c4) cos x = 2e7* + cosx. 
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Hence 


263 ΞΞ 2: 3c4 + 4cs -- 0, 308 — 4c4 = Ἰ; 
and 


C3 = 1, C4 = —x, 5 = He. 
Thus the desired particular solution is 


Vp = χε" — fe sin x + εξ COS x. 


EXERCISES 


Use the method of undetermined coefficients to find a particular solution for each of the 


following differential equations. 


1. D(D + Dy = 2x + 3e* 2. D(D + [1 = 2+ εξ 

3. D(D — 1)y = sinx 4. (D? + ly = 3cosx 

5. (D2 + 4D + 2)y = xe-** 6. (D2 + D — Oy = 6α + 1) 
7. (66D2 + 2D — Ly = 7Tx(x« + Ile? 8. (D? — 5D + 6)y = 

9, (ΡΖ — 4D + 5)yy = & + 1)8 10. (D? — 4D + ὃν = 


11. (D2 + 6D + 10)y = xt + 2x2 2 

12. (D? — D+ Py = xe? 

13. D(D2 — 2D + 10)y = 3xe* 

14. (D3 + 3D? + 3D + Ly = x* + 4x3 + 10x? + 20x 4+ 1 
15. (D3 — D? — D + Wy = 2x 4+ 2e-*) 

16. (D? — 3D — 2)y = e*(1 - xe?) 

17. (D? + D — 1)y = sinx + cosx 

18. D2(D? + 1)y = 1 + 2xe* 

19. D(D2 — 1)(D — 2ν = x? + 2x + 3 -- 265 

20. (ΡῈ + 5D? + 4)y = 2cosx 


—2 4 36x? + e* 
e22(1 + sin 2x) 


Give the form of a particular solution for each of the following equations. The coeffi- 


cients need not be evaluated. 

21. (D2 — 4D + 4)y = x(2e2* + x sin x) 

22. (D2 + 2D + 2)y = x? — 3xe—7* cos 5x 

23. (D2 + 1)3(D — τὴν = 3e7* + 5x2 cos x 

24, D2(D* — 4D? + 6D? — 4D + τὴν = (x? + 1) — e*) 
25. (D8 — 2D* + 1)y = (2x — 1)coshx + x sin x 

26: (D3 — 1)(D?2 + D — Dy = e/*% sin V3 x — xcosV3x 
27. (D3 — 1)8y = (2x + 126: + ~~" 

28. (D2? — 2D + 1)(D? — 4)*y = xsinh x + cosh 2x 

29. [(4D2 — 4D + 5)(D?2 + 2D + 1)]?y = χᾷ + e*/* sin x — x cos x) 
30. D(D? — 4)®y = (« + 1. 1(ὰ + 1) + sinh 2x) 


4-8 THE EULER EQUATION 161 


4-8 THE EULER EQUATION 


A linear differential equation of the form 


na "οὐδ d 
x” Ft dg ax" SF 00. αὐχ ὩΣ + apy = 0, (4-65) 
with do, ..., @,—1 constants, is called a (homogeneous) Euler equation of order n. 


The reader should note that this equation is defined on the entire x-axis, but is 
normal only on intervals which do not contain the point x = 0. It is one of the 
relatively few equations with variable coefficients that can be solved in closed 
form in terms of elementary functions, and is important because its solutions are, 
to some extent, typical of those of a large class of linear differential equations 
whose leading coefficient vanishes at the origin. 

As we Shall see, Eq. (4-65) can be converted into a (linear) equation with con- 
stant coefficients by making the change of variable u = In x, and hence can be 
solved by the methods introduced in this chapter.* Although this reduction can 
be effected in a routine fashion, it is illuminating to consider it from the point of 
view of linear operators by introducing the transformation T: C"(— οὐ, 0) — 
e”"(0, 0) defined by 


(Tg)(x) = g(in x) (4-66) 


for all gin C"(— οὐ, oo). Thus 7 maps the function x onto In x, sin x onto sin (In x), 
etc., and is obviously linear. More important, it is invertible, with (T~‘f)(x) = 
(65) for all fin C”(0, 0), and hence is a one-to-one linear transformation mapping 
©”(— οὐ, οο) onto C”(0, 0). From this it follows that the problem of solving the 
equation Ly = 0 on the interval (0, 0), with L = x”D" + an_yx" 105 1 + 
-++ + dg, 1s equivalent to the problem of finding all functions g in C"(— #, οὐ) 
such that LT7g = 0. In other words, we must find the null space of the transforma- 
tion LT. 

To this end we begin by computing the various products DT, D°T,..., as 
follows: 


DTg = Dg(inx) = : g’(in x) = iT Dg, 
ΟΡ = D(DTg) = D (: TDs) 
-- ἱτρ +1 ρ(αΡρ) 
108 Ὃ - g 
ἘΞ εἰν ΟΝ τ Ὁ 1 rps 
x2 XXX 


1 


* In the following discussion we shall restrict our attention to the interval (0, 0). On 
(— οὐ, 0) the change of variable u = In (—x) must be used. 
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and, in general, 


D'Tg = = TD(D — 1)..-(Ὁ -- Κ͵κ τὴ», k=1,2,.... 467 


Thus 
x"D'T = TD(D — 1)---(Ὁ — k + 1), 
and hence when 
1, τ x"D" + ay_yx"™ 1D"! + ++ + ayxD + ao, (4-68) 


we have | 
LT = TL, (4-69) 


where L is the constant coefficient linear differential operator 


= D(D — 1):°--(D—nt+1)4+ aa 1D(D -- 1): τ (DW -- ῤ πτ- 2) 
+-':+a,D + ao. (4-70) 


Equation (4-69), together with the fact that T is one-to-one, implies that the 
null space of the transformation LT coincides with the null space of [. This 
establishes our contention that (4-65) can be reduced to an equation with constant 
coefficients and also allows us to describe the solution of any (homogeneous) 
Euler equation on the interval (0, 0) as follows: 


The general solution on (0, «) of the equation Ly = 0, L as in (4-68), is 


y= cyyidin x) +: πε: CnYn(In x), (4-71) 
where y,(u),..., yn(u) are a basis for the solution space of the constant 
coefficient equation [Ly = 0, ἢ deduced from L by (4-70), and c,,...5 Cn 


are arbitrary constants. 


Finally, to remove the restriction on the interval, we note that for each non- 
negative integer k, 


x" D*g(—x) = x*(—1)*g(—x) = (—x)*D*g(—x). 


Hence if y(x) is a solution of the Euler equation Ly = 0 on (0, »), y(—x) is a 
solution on (— «, 0), and y(|x|) on (0, x) and (— w, 0) (see Exercise 12). 


EXAMPLE |. The Euler equation of order two. Let 
d° d 
oe ἘΞ + αιχ ay + apy = 0 (4-72) 


be a (homogeneous) Euler equation of order two. Then the constant coefficient 
linear differential operator ἢ appearing above is D(D — 1) + a,D + ao, and 
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the general solution y(x) of (4-72) is determined by the roots a1, ας of the quad- 
ratic equation 
m(m — 1) + aym + ao = 0, (4-73) 


known as the indicial equation associated with (4-72). Thus 
(i) if a, and ag are real, αἱ τέ ag, then 


V(X) = €4|x|% + co|x|%?; 
(ial wp es then 
yx) = [χ| (οι + ce In |x); 


act bi,ay = a — bi, b> 0, then 


(iii) if ay 
y(x) = [χ[[ς: sin (6 In |x|) + ce cos (6 In [χ|}}. 


We shall have occasion to refer to these results in a later chapter. 


EXAMPLE 2. Find the solution of 
x?y"” + Ixy’ — by = 0 (4-74) 


which passes through the point (1, 1) with slope zero. 
The indicial equation associated with (4-74) is 


m(m — 1) + 2m — 6 = 0, 


and has 2 and —3 as roots. Thus the general solution of (4-74) on (0, «) is 


Y = yx" + cox~%, 
and since the given initial conditions y(1) = 1, y/(1) = Ο imply that c, = 3, 
Co = 2, the required solution is 


2 —3 
y= ἔχ + Bx”. 


EXAMPLE 3. In Example 2 of Section 4—4 we said that the general solution of the 
equation 
xy’ + y =0 (4-75) 
is 
y = οἱ + cgIn |x|. (4-76) 


To prove this assertion we multiply (4-75) by x, and obtain the second order 
Euler equation x?y” + xy’ = 0. Here the indicial equation is m? = 0, and 
(4-74) now follows from the results of Example 1. 

The general solution of a nonhomogeneous Euler equation Ly = h, defined on 
an interval 7 not including the origin, can be obtained by using variation of param- 
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eters or the Green’s function for L (see Example 2, Section 4-4). But here too the 
problem can be reduced to one involving a constant coefficient equation, and is 
usually easier to solve in this form. To do so we again use the linear transformation 
T, this time to rewrite the equation | 7 
Ly =h (4-77) 
as 
LT(T—y) = T(T'h). 


But, by (4-69), LT = TL. Thus 
ΤΙ ἢ) = T(T~*h), 
and since 7 is one-to-one, this last equation may be rewritten 
[τ "»- ΤᾺ, (4-78) 


in which form it is a constant coefficient equation. Moreover, we can now assert 
that if y(u) is the general solution of (4-78) on I, then y(n |x|) is the general solution 
of (4-77) on I. 


EXAMPLE 4. Find the general solution of 


χἕγ' + xy = χ- x? (4-79) 
on (0, οὐ). 
In this case ἢ = D2, T~1(x + x”) = ὁ" + 62", and the transformed version 
of (4-79) is 
ἕν = ο" + e”. (4-80) 


The general solution of D?y = O is cy + Cou, and a particular solution of (4-80) 
may be found by using the method of undetermined coefficients on the expression 
Ae“ + Be?". A simple computation gives A = 1, B = 4. Thus the general 
solution of (4-80) is 

=e" + fe™ + οἱ + cou, 


and it follows that the general solution of (4-79) on (0, o) is 


x? 
y= ΧῊ  Ὑ ei + ¢ginx. 


EXERCISES 

Find the general solution of each of the following Euler equations. 

Ae ae 2. 4x2y" — ὃὅχγ' + Dy = 0 
x2y"” + xy’  9ν = 4. x*y"’ — 3xy’ + Ty = 0 


x2y" + xy’ — p*y = ee 6. 2x2y"” + xy’ —-y = 0 
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vn 


7. χἣγ"" — 2χγ" — 17xy’ — Ty = 0 8. x8y'""" — 3x2y" + 6χγ' — by = 
9, x3y'"” + 4x2y” — 2y = 0 10. x8y’” + 4x2y"" — 8xy’ + ὃν = 
UL. χγ(ν) - 6χϑγ"" + 7χ2γ" + xy’ — y = 0 

12. Let S be the linear transformation from Θ (0, ©) to C*(— οο, 0) defined by 


(50 0) = f(—~). 
(a) Show that S is one-to-one, onto, and that SL = LS whenever 
L = x*D*® + ag_1x"—!D™—-! +--+ + ayxD 4+ ao. 


(Ὁ) Use the results of (a) to prove that L(Sy) = 0 if and only if Ly = 0, L as above, 
and hence deduce that y(—x) is a solution of Ly = 0 on (-- οὔ, 0) if and only if 
y(x) is a solution on (0, ©). 

13. Compute the Green’s function for the linear differential operator χ D? πε aixD + ao 
on C(0, 7). 

14. Prove that (4-67) is valid for all positive integers k. [Hint: Use mathematical 
induction. ] 

15. (a) Let T be the linear transformation defined in (4-66), and let ὦ = D+ apo. 
Prove that 


| | 
oo 


TLT-! = xD + ao. 
(b) Let L = D2 + αι} + ao. Prove that 
TLT~1 = x?2D2 + (a; + 1)xD + ao. 


16. Prove that every linear differential operator of the form 
L = χρη + ag—1x"—1D°-1 + ...- ayxD + ag 


can be written as a product of operators of this form of orders one and two. [Hint: 
Let L be the constant coefficient operator associated with L, and write 


L = Lile--+ Ly, 


where ἦς, i = 1,...,k, is a constant coefficient operator of order one or two. 
Show that ; ᾿ : 
= (TLiT~!)(TLeT—')--- TL,T—), 
and use the results of Exercise 15.] 
17. Use the results of Exercises 15 and 16 to factor each of the following operators. 
(a) x?D? + 2xD — 2 (b) x2D2 ++ D—9 
(c) x? ὅ — 2x2D? — 17xD — 7 (d) x? 8 — 3x2D? + 6xD — 6 
(e) x*D* + 6x? D? + 7x2D?2 + xD — 1 
Find a particular solution of each of the following Euler equations on (— ©, ©). 
18. x2y"” + xy’ --9 = χ +1 
19. x?y’"’ + xy’ + 9 = sin (In x3) 
20. x?y"” + 4xy’ + 2y = 2Inx 
21. x3y'" + 4x2y" + xy’ + y = 
22. x2y’" + xy” + 4y’ = 1 + cos ἐν In x) 
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4-9 ELEMENTARY APPLICATIONS 


We conclude this chapter with several examples illustrating the way in which 
linear differential equations arise in the study of natural phenomena. Although 
the problems we discuss are rather simple—at least from a physical point of 
view—they are not entirely without interest, and should be construed as reason- 
able, albeit elementary, applications of differential equations to biology and physics. 
Some of a more substantial nature will be considered in later chapters. 

I. The growth of populations. Problems of this type consist of determining the 
future size of a population under the assumption that its rate of growth is known, 
and arise in such diverse situations as the radioactive decay of matter and the 
increase of bacteria in a culture. In such problems it is frequently assumed that 
the rate of increase (or decrease) in population at time ¢ is proportional to the 
number of individuals present at that time.* Then if y(t) denotes the number of 
individuals present at time 1, 

Y = ky (4-81) 
for an appropriate constant k, and it follows that y obeys the well known law of 
exponential growth 

y = ce, (4-82) 
c a positive constant. 

Hypotheses which result in something more realistic than prolonged exponential 
growth are, of course, also used. One of the simpliest of these is the assumption 
that the supply of necessities for life is constant and sufficient to support a total 
population P. This implies that the factor of proportionality in (4-81) depends 
upon y and P, and approaches zero as y approaches P. Thus y must now satisfy 
a nonlinear equation of the form 


& = ΓΟ, Py, (4-83) 


where f has to be determined experimentally. If, for instance, f(y, P) = P — y, 
(4-83) becomes 


and can be solved as a Bernoulli equation. Indeed, making the substitution 
u = γ᾿, we find that 


du I] 
= d = Pt 
PP + Pu = 1, an u= 5 (1+ ce’). 


* In the case of living organisms it has been found that this assumption is fairly accurate 
when the population is small in comparison with the availability of such necessities as 
food, living space, etc. For radioactive decay, short of an atomic explosion, the assump- 
tion is in complete accord with experimental fact. 
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Thus 
ee. ee 
Y= T+ ce-Pi 


and if we assume that y(0) = Po, we have 


ΘΟ << eee 
» Po t+ (PP — Poet 


In Fig. 4-4 we have sketched a number of these curves for various values of Po. 


y 


FIGURE 4-4 


II. The simple pendulum. An overwhelming majority of the problems en- 
countered in elementary physics are solved by invoking Newton’s second law of 
motion which, in crude form, asserts that the (vector) sum of the forces acting on 
a moving object is proportional to the product of the mass m of the object and 
its acceleration a; that is, 

F = kma. (4-84) 


The reader should note that in 3-space this equation can be rewritten as a system 
of three scalar equations 


F, = kma;z, 
Fy = kmay, 
F, = kma,, 


where F;,, az, etc., denote, respectively, the x-, y-, z-components of F and a. 
For convenience the physical units are usually chosen so that k = 1 in these equa- 
tions, and in the future we shall always assume this choice has been made. 

As it stands, Eq. (4-84) assumes that mis constant. A slightly more sophisticated 
formula which avoids this assumption is 


d 
F = a (mv), (4-85) 
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where v denotes velocity. The quantity mv appearing in (4-85) is known as the 
momentum of the object, and in this form Newton’s second law says that the 
(vector) sum of the forces acting on a moving particle is equal to the time deriva- 
tive of its momentum. This, for example, would be the equation used to study 
the flight of a rocket whose mass decreases as its fuel 15 consumed. 

As an illustration of how Newton’s second law is used to solve an elementary 
problem we consider a pendulum bob of mass m supported at the end of a string 
as shown in Fig. 4-5. The forces acting on the bob are the tension T in the string 
and the vertical force mg due to gravity. Let y denote the angular displacement of 
the string from the vertical. Then the component of the gravitational force parallel 
to the string balances the tension, while the component perpendicular to the 
string provides the tangential restoring force which causes the pendulum to oscillate. 
Since the magnitude of this tangential force is mg sin φ, and since the momentum 
of the bob is mv = mL(dy/dt), Newton’s second law gives 


T us 
a Le ate «πὶ 
di (mt ie) mg Sin ¢, 5 <¢< 5 


If we now assume that ¢ is smal] so that sing ~ φ, the 
above equation may be replaced by the linear equation 


de δ΄... 
ae ee Ms (4-87) 
whose general solution is 
g(t) = cy sin g/Lt + cocosVg/Lt. mg FIGURE 4-5 


Finally, if we assume that the pendulum was initially released from rest at an 
angle φρο from the vertical, then 9(0) = ¢o, ¢’(0) = 0, and the corresponding 
particular solution of (4-87) is ¢(t) = go cos ν 3. 11. The student should recog- 
nize this as the equation for simple harmonic motion whose period of oscillation 


is 2\/L/g. 


EXERCISES 


1. The half-life of a radioactive substance is defined as the length of time required for 
half of the atoms in any sample of the substance to decay. 
(a) The half-life of radioactive carbon 14 is 5600 years. Find the amount of carbon 14 
remaining in a sample of amount xo at the end of ¢ years. (Assume that the rate of 
decay is proportional to the amount present.) 
(b) If 90% of the carbon 14 in a given sample of carbon has decayed, find the age 
of the sample. 


10. 


11. 


12. 
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. If 20% of a certain radioactive substance disintegrates in 50 years, find the half-life 


of the substance. 


. A radioactive substance with a half-life of 50 years lies exposed to the weather, and 


erodes at a constant rate of k pounds per year. 


(a) Find the formula for the amount of material remaining after t years in a sample 
which originally contained xo pounds. 


(b) How long will it take for the substance to disappear entirely ? 


. Bacteria in a certain colony are born and die at rates proportional to the number 


present, so that the equation governing the growth of the colony is 


dy _ 
dt = (ki ka)y. 


Determine Κι and kg if it is known that the colony doubles in size every 24 hours, 
and would have its size halved in 8 hours were there no births. 


. If the population of a certain colony of bacteria doubles in 40 hours, how long will 
it take for the population to increase 10-fold? 


. The population of a country increases 3% per year; its present population is 190 


million. 
(a) How many years will elapse before the population reaches 250 million? 
(b) What will the total population be in 5 years? In 50 years? 


. Solve Exercise 6 under the additional assumption that the country admits 200,000 


immigrants each year. 


. What is the annual rate of interest being paid on an account where interest is con- 


tinuously credited at the rate of 5%? 


. Assume that evaporation causes a spherical raindrop to decrease in volume at a 


rate proportional to its surface area, and find the length of time it will take a drop 
of radius ro to evaporate entirely. 


It can be shown that a body inside the earth is attracted 
toward the center by a force which is directly proportional 
to the distance from the center. Find the equation of mo- 
tion of a ball dropped into a hole bored through the center 
of the earth. When will the ball reach the opposite end of 
the hole? 


Liquid is oscillating without friction in a U-tube as shown 
in Figure 4-6. If the liquid was initially at rest with one 
side io inches higher than the other, determine the subse- 
quent motion of the liquid by finding ἡ as a function of 
time. Show that the period of oscillation is πν 21,75, 
where L is the total length of liquid in the tube, and g the FIGURE 4-6 
acceleration of gravity. 

The angular momentum of a rotating body is given by the formula T = Ja, where T 
is the torque applied, J the moment of intertia of the body about its axis of rota- 
tion, and a = d*y/dt? is the angular acceleration. Suppose that a bob on a twisted 
wire resists the twisting force with a torque ky. Find Jas a function of time if k = 1 
and the period of rotation is half a second. 
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4-10 SIMPLE ELECTRICAL CIRCUITS 


The flow of current in an electrical network consisting of a finite number of 
closed loops, or circuits, is governed by the following rules known as Kirchhoff’s 
laws: 

(a) The algebraic sum of thé currents flowing into any point in the network 
15 Zero; 

(b) The algebraic sum of the voltage drops across the various electrical com- 
ponents in any oriented closed loop in the network is zero.* 


In this discussion we shall restrict our attention to networks consisting of a 
single circuit made up of a voltage source £, a resistance R, a capacitance C, and 
an inductance L, the last in the form, say, of a coil of copper wire. The formulas 
relating the flow of current i to the voltage drop across each of these components 
are 


Er = iR for a resistance, 
E, = L εἰ for an inductance, (4-88) 
i=C a for a capacitance. 


We begin by considering the R-L circuit shown in Fig. 4-7, where the symbol 
—i | 8 — denotes a constant source of voltage E such as might be supplied by 
a battery, and the arrows indicate the direction of the flow of current. By Kirchhoff’s 
second law we have 

E, + Er -- Ε =), 


the negative sign being due to the fact that the voltage rises across the battery. 
Hence, by (4-88), 


Die ... 
Lit Ri= Ε, 


and if we now assume that the circuit was energized at time ¢ = 0, the flow of 
current is obtained as the solution of the initial value problem 


Le + Ri= E, i(0) = 0. (4-89) 

An easy computation reveals that 
a 5 — ει (4-90) 
and we see that the current flow in this circuit is a sum of two terms, a time 


* A closed curve is said to be oriented if a positive direction has been assigned for 
traversing it. 
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FIGURE 4-7 FIGURE 4-8 


independent steady-state term E/R, and a transient term —(E/R)e~?!™*, 
whose effect diminishes with time. (See Fig. 4-8.) Since the inductance L appears 
only in the latter term it follows that a simple R-L circuit operating under a con- 
stant impressed voltage will eventually behave very much as if the circuit were 
noninductive. The length of time required for the transient term to become 
negligible is sometimes called the delay time of the circuit, and furnishes a measure 
of its sensitivity in responding to the voltage source E. 

If we replace the battery in the above circuit by an alternating current source 
E sin wt, (4-89) becomes 


Le + Ri= Esinwt, i(0) = 0. (4-91) 


This time the solution assumes the more complicated form 


wEL e (RIL)t 4 E 


“ἊΣ. wD? «ἜΣ + w2L2 


(see Exercise 2), which may be rewritten 


i (Rsinwt — whcoswt) (4-92) 


_ wEL 
τ“ Ζ2 


by setting R = Zcosa and wl = Zsina, where Ζ = ν 2 + w2L?. Again 
the flow is the sum of two terms, i; and i,, the first of which is transient and dies 
out as ¢ increases. The second, 


ὁ (RIL I Ὁ 5 sin (po (4-93) 


: Ε. 

i, = > Sin (wt — a), 
is the steady-state current, and is sinusoidal in nature as one might expect. It 
differs from the impressed voltage E sin wt by the phase angle a and the multi- 
plicative factor 1/Z. (The quantity Z = ./R?2 + w?L? is called the steady-state 
impedance of the circuit.) Thus the graph of the steady-state current can be 


172 EQUATIONS WITH CONSTANT COEFFICIENTS CHAP. 4 


Is =5 sin (wf — α) 


wt 


FIGURE 4-9 


obtained by multiplying the amplitude of the graph of the impressed voltage by 
-1/Z, and translating the result a units to the right (see Fig. 4-9). Since 0 < 
a < 2/2, the current in such a circuit is said to Jag the voltage by the phase angle a. 
Finally, since 


a 


sin wl and cos ᾽ 
c= --» α ΞΞ -», 
Ζ Ζ 


we see that a = Ο in a purely resistive circuit (L = 0), and that a = 7/2 ina 
purely inductive circuit (R = 0). Hence when L = 0 the current and voltage are 
in phase, while when R = Ο they are 90° out of phase. In either case the reader 
will note that the steady-state impedance plays exactly the same role that the 
resistance plays in an R-L circuit under a 
constant voltage, a fact which explains the 
use of the term “impedance” here. 

We now consider a simple R-L-C cir- 
cuit under a sinusoidal impressed voltage 
E sin wt (see Fig. 4-10). In this case itis ΞΕ ςἴη ot 
“somewhat simpler to describe the state 
of the system in terms of the charge g on 
the capacitor as a function of time, rather 
than in terms of the current 7. Since 


R 


i= dt. (4-94) FIGURE 4-10 


the voltage drop across a capacitor is (1/C)q, and Kirchhoff’s second law leads to 
the equation 
d°q 1 στο 
Lag + Ra + 64 81 οἱ (4-95) 
governing the accumulation of charge q(7) on the capacitor in the circuit. Thus 
the behavior of this circuit can be determined as soon as the initial values of q 
and i = dq/dt are known. 
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The solution g, of the homogeneous equation associated with (4-95) can be 
expressed in terms of the roots 


R, (RY 1 
OL 2L LC 


Lm? + Rm + 4 = 0. 


of the auxiliary equation 


Thus g;, assumes different forms depending on whether 


(2) 1 
2L) 1ς 
is positive, negative, or zero. However, it is easily seen that no matter what initial 
conditions are imposed on the circuit, gq, 0 as t— o. In other words, 4, 
represents a transient charge on the capacitor, and as ¢ increases, the time variation 
q(t) of the charge on the capacitor approaches a steady-state value q,(t), which can 
be determined by finding a particular solution of (4-95). Furthermore, it is 
interesting to note that this steady-state charge is independent of the initial con- 
ditions g(0) and i(0) imposed on the circuit, and depends only on R, L, C, and 
Esin wt. [Why?] This observation is in agreement with our intuition which 
suggests that the long-range behavior of such a circuit ought to depend only upon 
its components, and not upon their state at time ¢ = 0. 

We now find the steady-state behavior of this system under the assumption 
that R σέ 0. In this case E sin wt cannot be a solution of (4-95) for any value of 
E, and hence the equation has a particular solution of the form 


Gs = σι SIN wt + Co COs at. 


When this expression is substituted in (4-95) and the resulting identity solved for 
c, and Co, we obtain 
_ Awl -- (ὁ 
οἰ ΚΞ + [wl — (1/wC)}?} 
.Ὀ.Ὀ- ence 
w{R? + [wl — (1/wC))}?} 


Cy = 
Co = 
If we introduce the abbreviations _ 
l 2 
Y = wh -- —> z= + (4 - x) 
® ῳ 
the particular solution g, may be written 


᾿ς Ey . ER 
qa: = - Ze sin wt - 575. Ὅ5ὼ), 
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or even more simply 


E | 

qs = — ωΖ cos (wt - a), (4-96) 
where sina = Y/Zandcosa = R/Z. Finally, by differentiating this expression 
we find that the steady-state current for an R-L-C circuit is 


is = 5 sin (wt — a). (4-97) 
As in the case of an R-L circuit with impressed electromotive force EF sin wt, the 
constants a and Z are called the phase angle and steady-state impedance of the 
circuit. In fact, it is customary to view an R-L circuit as the limiting case of an 
R-L-C circuit obtained by setting C = o. 

Since the steady-state impedance 


Z = VR? + [ol — C/o) 


in an R-L-C circuit depends upon w, the maximum amplitude E/Z of the steady- 
state current i, also depends on w. It is clear that for fixed values of L and C the 
quantity E/Z is a maximum when wL — 1/wC vanishes, i.e., when ὦ = 1/\/LC, 
and for this value of w, E/Z = E/R. Thus, if we plot E/Z, the amplitude of ig, 
as a function of w, the graph will attain its maximum value when ὦ = | /VLC. 
Furthermore, this maximum increases with decreasing R, as shown in Fig. 4-11. 
Physically, these observations tell us that the circuit may react quite differently to 
input voltages with different frequencies w. The more the frequency differs from 
1/./LC, the smaller the amplitude of the steady-state current becomes, and hence 
the voltage drop across the various components of the circuit is small. By minimiz- 
ing its resistance, such a circuit can be made highly selective, in the sense that it 
discriminates very sharply against inputs whose frequency differs from the circuit’s 
natural or resonating frequency 1/\/LC. 
Thus if a mixture of sinusoidal input 
voltages of the same magnitude is applied 
to an R-L-C circuit of high selectivity, so 
that the impressed electromotive force is 
a sum of the form 


nr 
Σ Εϑηω;,, 
t=1 


the steady-state current will depend almost 
exclusively on those terms whose frequen- 
cies ὡς are very close to the natural frequency 
1/\/LC. The use of such circuits as tuning 
circuits or filters in electronic equipment is 
obvious. FIGURE 4-11 
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EXERCISES* 


1. 


2. 
3: 


Find the current flow in a simple R-Z circuit under a damped sinusoidal voltage 
Eoe— sin bt, with Eo, a, b constants, a > 0. [Assume that at time 2 = 0, i(0) = io.] 
Verify Eq. (4—92) of the text. 

A simple circuit consisting of a condenser 

and a resistor is connected as shown in Fig. 

4-12. Suppose that C initially carries a charge 

of 0.03 coulombs and that the switch is closed 

at time {1 = 0. C R 
(a) Find q(¢) as a function of time. 

(Ὁ) Sketch the graph of q(7). 

(c) Find the voltage drop across the resistor 

after 10 seconds have elapsed if C = 300 

microfarads (300 x 10—® farad) and R = FIGURE 4-12 
10,000 ohms. 


. Replace the resistor in the circuit of Exercise 3 by an inductance L, and show that 


the charge g on the condenser satisfies the equation 


Solve this equation under the initial conditions i(0) = 0, g(0) = 0.03 coulombs. 
Sketch the graph of the solution. 


. Add an inductance to the circuit in Exercise 3 and solve the resulting differential 


equation, considering separately the three cases 
R>2WL/C, R=2VL/C, R < 2VL/C. 


Sketch the graphs of the three types of solutions obtained. (In this situation the 
resistance R corresponds to a mechanical damping force, and these three cases yield, 
respectively, overdamping, critical damping, and underdamping.) 


. Find the current flow in a simple R-Z circuit under a constant voltage given that 


R = 40ohms, L = 8 henries, and that E = Ovolts and i = 10 amperes when 
t = 0. At what time will i = 5 amperes? 


. If the resistance is removed from the R-L-C circuit discussed in the text, g satisfies 


the differential equation 


d’q 1 : 
Ἴ + C4 = FE sin wt. 


Solve this equation in the two cases 


L 


(1) De eee Gi) w = ——> 


VLC VLC 


* The units of measurement used in the following exercises are resistance in ohms, 


inductance in henries, capacitance in farads, current in amperes, charge in coulombs. 
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and discuss the behavior of the solution in each case. Which of these cases exhibits 
the phenomenon of resonance? [Note that in the resonant case the voltage drop 
across the capacitor oscillates with the same frequency as the input voltage 
(E sin t)/\/LC. Its amplitude, however, is unbounded. This is the limiting case of 
an R-L-C circuit when R = 0, but, of course, can only be approximated in practice.] 


. Suppose that g(0) = qg’(0) = 0, and that R = 5 ohms, C = 300 microfarads 


(300 Χ 10-6 farad), and that L = 0.1 henries in the R-L-C circuit discussed in the 
text. If the impressed electromotive force is the standard 110-volt, 60-cycle alter- 
nating current in common use (i.e., Esin wt = 1102 sin (1207), since it is the 
effective and not the peak voltage which is 110 volts), find g as a function of time. 
What is the voltage drop across R after 10 seconds? Across L? 


9 


the laplace transform 


5-1 INTRODUCTION 


In this chapter we shall for the first time make full use of the idea of a linear 
operator and its inverse in solving initial-value problems involving linear differen- 
tial equations. By contrast to the rather pedestrian methods developed in the last 
chapter, our present investigations will yield an extremely efficient technique for 
handling such problems. In addition, they will give a much deeper insight into the 
role which operator theory plays in applied mathematics, and will serve as an 
excellent introduction to a general method which will be used later to analyze 
more difficult problems. | 

The particular linear transformation which we now intend to study is an integral 
operator £ known as the Laplace transform. Before giving the definition, however, 
we introduce the notion of a piecewise continuous function, which will be needed 
when we describe the domain of &£. 

Informally, a real valued function is 
said to be piecewise continuous on a closed 
interval if its graph consists of a finite 
number of continuous pieces. More pre- 
cisely, f is piecewise continuous on [a, b] 
if it is continuous at all but a finite num- 
ber of points of this interval and if at each 
point x9 of discontinuity both the right 
and left limits of f exist; that is, f(x9 + A) FIGURE 5-1 
and f(x9 — A) both tend to a finite limit 
as h tends to zero through positive values.* Thus such functions as 1“, sin f, 
and the “‘square wave”’ function shown in Fig. 5-1 are piecewise continuous on 
any finite interval of the f-axis. On the other hand, neither tan ¢ nor sin 1/t is 
piecewise continuous on [0, 7/2]; the first because of its behavior near 7/2, the 
second because it oscillates in such a manner that it does not approach a limit 
as 1 — 0 (see Exercise 10). 


* Note that only one of these limits is relevant when xo is an endpoint of the interval. 
177 
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For our purposes the essential fact concerning piecewise continuous functions 
on a finite interval is that they are integrable. Indeed, if fis piecewise continuous 
on [a, δ], with discontinuities at x9, X1,...,Xn, and possibly at a and ὦ as well, 
then f° f(t) dt is defined and evaluated as 


ΓΙ “τῶ αι + [ἢ Pot errr on ae SO at]: 


Zy+ 


an im, | 


where the notation ἢ — ΟἿ means that A approaches zero through positive values 
only. (See Fig. 5-2.) It is known that this limit always exists, and the student 
presumably has had practice heretofore in evaluating such integrals. 

At this point a number of trivial re- 
marks are in order. The first concerns 
our use of the letter ¢ in place of x for the 
independent variable. This is nothing 
more than a convention which is all but 
universal when discussing the Laplace 
transform, and stems from the fact that in 
most initial-value problems the independ- 
ent variable is time. Moreover, since 
negative values of time are usually ex- FIGURE 5-2 
cluded, it is also standard practice to re- 
strict attention to the non-negative f-axis [0, 0). In this context we shall be 
interested in functions which are piecewise continuous on every finite interval 
[0, to], to > 0, and for the sake of brevity shall say that such functions are piece- 
wise continuous on [0, 0). Finally, the set of all such functions is obviously a 
real vector space under the definitions of vector addition and scalar multiplication 
given in Chapter 1 (see Exercise 5).* We shall have more to say about this space 
in the sections which follow. 


A 


Q 
bas 
Θ 
= 
ἐδ 
σ- 


EXERCISES 


1. Which of the following functions are piecewise continuous on [0, ©)? Give reasons 
for your answers. 


+ 1 t—2 


(αν τ εἰ (e) εἶ“ 


+” 2 
(a) e (b) In(@ + 1) 
2. Repeat Exercise 1 for the following functions. 


sin ¢t ee 
(a) te na positive integer 


(b) τ' (c) f(t) = [|| the greatest integer less than f 
1 
Oift = —»>n = 1,2,... 
(d) f(t) = : n (e) f(t) = 0, ¢ an meet 
1 otherwise 


1 otherwise 


* That is, (f+ δ) = fO + g@ and (ἡ = af(. 
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3. Prove that for any real number a, e*‘f(¢) is piecewise continuous on [0, ©) whenever 
fis. 

4. Prove that the product of two piecewise continuous functions on [0, ©) is piecewise 
continuous. 

5. Prove that the set of all piecewise continuous functions on an interval J is a real 
vector space under the “usual” definitions of addition and scalar multiplication. 


Evaluate fi ¢ f(t) dt for each of the following functions. 
6. ft) = Ih 0<rt<1 

f ἢ = fl «2 
7. f(t) = cos |r| 


4 — 1, 0O<t<34 
8. f= bose! 9. ft) = 44 — βι- 3,2 «τς 


10. Show that lim;_,9+ (sin 1/1) does not exist. [Hint: Sketch the graph of sin 1/7 in 
the interval (0, ).] 
11. Does lim;_,o9+ (¢ sin 1/f) exist? Is ¢sin 1/t piecewise continuous on [0, ©)? 


5-2 DEFINITION OF THE LAPLACE TRANSFORM 


Let f(t) be a real valued function on the interval (0, 0) and consider 
[e's dt, (5-1) 
0 


where s is a real variable.* Whenever f is sufficiently well behaved this integral 
will converge for certain values of s, in which case it defines a function of s called 
the Laplace transform of f, and denoted £[f], or £[f](s). Thus if f(t) = cos at, 
where a is a constant, then 


ao 
L[cos at](s) = | ο΄ δ᾿ cos at dt 
0 
to 
= lim e** cos at dt 
tg—00 0 


—st to 
= lim - (a sin αἱ — scosat) 
toro (S* Τ a 0 
e *to s 
= lim ΕΞ- (a sin atg — 5 608 ato) + ———s]: 
to LS? + a? s? + a? 


* We recall that an integral of this sort is evaluated according to the rule 
00 t 
[ e*' f(t) dt = lim [ ° et) dt, 
0 tg— 0 0 


and is said to converge for a particular value of s if and only if this limit exists. 
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Since this limit exists if and only if s > 0, in which case it has the value s/(s* + a), 
it follows that the Laplace transform of cos at is the function s/(s? + a?) re- 
stricted to the interval (0, 0). In other words, 


L{cos at] = s> 0. (5-2) 


5 
2 a’ 

In most of our applications it will be possible to compute £[ f] by direct evalua- 
tion of (5-1) as was done above. This, however, does not obviate the need for 
determining a “reasonable” set of conditions which will insure the existence of 
the Laplace transform of a given function f, particularly since we wish to view £ 
as a linear transformation defined on a suitable vector space. If we examine 
(5-1) from this point of view it is clear that f must be so chosen that 


[ o£) dt (5-3) 


exists for all tg > 0. This can be accomplished by demanding that f be piecewise 
continuous on every interval of the form [0, fo], t9 > 0, for then the integrand in 
(5-3) will be piecewise continuous, and the integral will exist. (See Exercise 4, 
Section 5-1.) Piecewise continuity by itself, however, is not enough to guarantee 
the existence of £[ f] since (5-3) must also converge as ty — οὐ for at least one 
value of s. One way of assuring this convergence is to require that f(t) be “domi- 
nated” by some exponential function, thus in effect demanding that e—*' f(t) ap- 
proaches zero rapidly as 1 increases. To make this notion precise we lay down 
the following definition. | 


Definition 5—1. A function f is said to be of exponential order on [0, «) 
if there exist constants C and a, C > 0, such that 


ee eee ΧΩ] < οὐ’ (5-4) 
or all ὦ 


In a moment we shall prove that the Laplace transform of any piecewise continuous 
function of exponential order does in fact exist, but first some examples. 

The constant function f(t) = 1 is of exponential order, as can be seen by 
setting a = 0, C = 1 in (5-4). So too—and this is important—are the functions 
προ. 


1”, e**, sin bt, cos bt, t"e*’ sin bt, t"e*’ cos bt, 


familiar from the study of constant coefficient linear differential equations. For 
instance, the proof that {ε΄ cos bt is of exponential order goes as follows: If 
a> QO, 


t’e’ cos bt} , te’ it” 
e2at — e2at " eat 


* This inequality need only be satisfied, of course, at those points of the non-negative 
t-axis where f is defined. 
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and L’H6pital’s rule shows that this expression tends to zero as t > o. In 
particular, it is eventually less than 1, and hence |t"e*’ cos δὴ] < e?* for 
sufficiently large values of ¢. Thus there exists a constant C > 0 such that 
|t”e*’ cos δὴ < Ce? for all t > 0 (see Exercise 14 below). If a < 0 the proof 
is even easier, for then 


|t"e*’ cos δὴ < ft”, 


and -the inequality ¢” < δ᾽ for large values of t implies the existence of a constant 
C > Osuch that |t"e*' cos δὴ] < Ce’ for allt > 0. 
On the other hand, the function e’ is not of exponential order, since 
t2 
lim — = lime" = w 


t—o0 eat ta 


for all a. 


This having been said, we now prove the theorem which justifies introducing 
functions of exponential order in the first place. 


Theorem 5-1. Jf f is a piecewise continuous function of exponential order, 
there exists a real number a such that 


[ero at 
0 
converges for all values of s > a. 


Proof. This assertion is an immediate consequence of a well-known comparison 
theorem from analysis; viz., if fand g are integrable on every interval of the form 
[a, b], where a is fixed and b > ais arbitrary, and if |f(d| < g(f) for all t > a, 
then ((΄ f(t) dt exists whenever f,” g(t) dt exists.* 

Granting the truth of this result, choose C and a so that |f(#)| < Ce’ for all 
t > 0 (recall that fis of exponential order). Then 


J ” e*(Ce*) dt = C [ “εἰ το gy 
0 0 


= jim “5 ῃι- e040 
ἐς. S — a 

= c if s>a, 
Ss = @ 


and the comparison theorem implies that fy e—*’ f(a) dt exists for alls > a. § 


On the strength of this result we can assert that the domain of definition of the 
Laplace transform of a piecewise continuous function of exponential order always 


* The student who has not already met this theorem may be willing to accept it when 
we point out that it is the analog for integrable functions of the comparison test for the 
convergence of infinite series. For a proof see Appendix I. 
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includes a semi-infinite interval of the form (a, oo). In point of fact, if sp denotes 
the greatest lower bound of the set of real numbers a such that £L[f](s) exists for 
alls > a, it can be shown that £[ f](s) does not converge for anys < so.* Thus, 
with the possible exception of the point 50 itself, the domain of definition of £[f] 
is the open interval (50. oo), and for this reason sg is known as the abscissa of 
convergence of the function f. (Note that for certain functions such as e~* or 0, 
Sq may be — οὐ.) 

The Laplace transform of any function of exponential order exists; this much 
we know. But what about the converse? Is it true that a function whose Laplace 
transform exists is necessarily of exponential order? The answer is no, and, as a 
matter of fact, the function 1/./t has a Laplace transform even though it is not 
of exponential order. All of this is by way of saying that the set of functions 
possessing Laplace transforms is larger than the set & of functions of exponential 
order. How much larger we shall not say, for it is no easy matter to specify the 
domain of £ precisely. Fortunately the set of functions of exponential order 
contains all of the functions which arise in applications, and as such is large enough 
for most purposes. 


EXERCISES 


Compute the Laplace transform and abscissa of convergence of each of the following 
functions. 


a hy. Ot <4 
1.1 2. οἷ" 3 fi) = fh OS! 
4.1 5. sin at 6. Κῶ = (> Os ts! 
t, t>1 
Prove that each of the following functions is of exponential order. 
7. 15, na positive integer 8. e%! 9. sin bt 
10. cos bt ll. nddi+9 12. Vt 


*13. Show that the Laplace transform of a function f may exist even though /f “‘grows 
too fast’? to be of exponential order. 


14. Let f be piecewise continuous on [0, ©), and suppose that there exist constants C 
and a such that [ἢ (1)| < Ce* whenever ἡ > to > 0. Prove that fis of exponential 
order. 


15. Prove that the product of two functions of exponential order is of exponential order. 


* Recall that ὁ is a lower bound of a nonempty set S of real numbers if and only if 
b <_ sfor all s in S, and that B is a greatest lower bound of S if and only if B is a lower 
bound of 5 and B > 5b for every lower bound ὁ of S. One of the most important proper- 
ties of the real number system is that every nonempty set S of real numbers has a unique 
greatest lower bound B (provided B is allowed to assume the value — οὐ wherever S has 
no finite lower bound). 


16. 


17. 


18. 


19. 


20. 


21. 
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Let f be piecewise continuous on [0, ©). 
(a) Prove that fis of exponential order whenever there exists a constant a such that - 


tim LO _ 0, 


f—+0 et 


(b) Prove that fis not of exponential order if 


for all real numbers a. 

Use the results of the preceding exercise to prove that e“* is of exponential order 
ifa < 1, and notifa > 1. 

Is the function ζ΄ of exponential order on [0, ©)? [Hint: Use Exercise 16 and the 
identity 1 = οἱ I" ἐ} 

Another version of the integral comparison theorem stated in the proof of Theorem 
5-1 is the following. If fand g are integrable on [a, 1], 0 < a < 1, and if | f()| < 
g(t) whenever 0 < ¢ < 1, then fo (2 dt exists whenever [ἢ g(#) dt exists. Use this 
result to prove that 1/+/t has a Laplace transform. 


~~ st Lo igs oe —st 
e e e 
[ Hint: | dt = | —dt+ | at.) 
0 Vt 0/1 1 Jt 
Let f be a function of exponential order, and let ao be the least real number such 
that for some constant C, 


ΧΩ] < Cen 
for alla > ao. © 


(a) Show that ao > So, the abscissa of convergence of f. 
(Ὁ) Show that there exist functions for which ag > so. [Hint: Consider the function 


f(t) = οἰ if tis an dea 
0 otherwise. 


Let f be piecewise continuous and bounded on [0, ©); i.e., there exists a constant M 


such that | f()| < M for allt > 0. Prove that fis a function of exponential order 
with abscissa of convergence < 0. 
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Let & denote the set of all piecewise continuous functions of exponential order, 
viewed as a real vector space under the usual definitions of addition and scalar 
multiplication, and let $ denote the set of all real valued functions defined on 
intervals of the form (50. 0) or [50» 0), 59 > —oo. Then § too can be made into 
a real vector space provided we modify the addition used heretofore in function 
spaces to accommodate the fact that the members of § are not all defined on the 
same interval. Specifically, if f and g are any two functions in , f + g is defined 
to be the function whose domain is the intersection of the domains of f and g, 
and whose value at any point s in that intersection is f(s) + g(s). Then, with 
scalar multiplication as usual, 5 is a real vector space (see Exercise 1). 
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By virtue of the observations made following the proof of Theorem 5-1, we 
can assert that the Laplace transform £ maps the vector space & into the vector 
space $, and it is only natural to ask if this mapping is linear. It might seem 
that the answer to this question is obvious, but, unfortunately, the obvious 
answer is wrong. The difficulty arises from the fact that £[f + g] need not be 
the same function as ὦ] + L[g], as can be seen by considering the case where 
S()) = cos at and g(t) = —cosat. For then £[f] + L[g] is the function which 
is zero on the interval (0, 00), but is not defined for 5 < 0, while £[f + g] = £[0] 
is the zero function on the entire s-axis (— οὐ, οὐ). From this it is clear that we are 
only entitled to say that £[f + g]and £[f] + L[g] are identical for those values 
of s where both of these functions are defined, a statement which is not at all the 
Same as asserting their equality.* 

But once this difficulty has been recognized, it is clear that it can be circum- 
vented simply by agreeing to regard two functions in § as identical whenever they 
coincide on an interval of the form (a, o). (Thus, for example, the two functions 
encountered above are “identified,” meaning that they are considered as one 
and the same.) Enforcing this identification, it is now an easy matter to prove that 
LL f + g] = £[f] + L[¢] for any two functions f and g in ὃ, and since, in any 
event, [af] = aL[f] whenever a is a real number, we have succeeded in inter- 
preting £ as a linear transformation from ὃ to δ. 

This done, we now ask if £& is one-to-one; 1.e., does L[f] = L[g] imply that 
f = g? The reader should recognize that this is just another way of asking if an 
operator equation of the form 


Lly] = φῇ) 


can be solved uniquely for y when ¢ is given, and by now he should realize that 
this is not an idle question. As in the discussion of the linearity of £, there is a 
trivial difficulty which prevents us from giving an affirmative answer. For if f 
and g are functions in & which differ only at their points of discontinuity, then 
L[f] = L[g] even though f ~ g. But two such functions are “‘very nearly” identi- 
cal, and should this be the worst that can happen we would certainly be justified 
in asserting that for all practical purposes £ is one-to-one. The following theorem 
guarantees that it is, and for this reason is one of the most important results in the 
theory of the Laplace transform. 


* Recall that two functions are equal if and only if they have the same domain and 
take the same value at each point in this domain. 
+ Strictly speaking, we should at this point replace 5 by the vector space $* whose 
lements are equivalence classes of functions in § as determined by the above process of 
identification (see Exercise 3). Then the mapping £* : ὃ -- $* defined by L£*[f] = LL[f]*, 
where £[f]* denotes the equivalence class in 5* containing the function £L[f], is the 
linear transformation in question. It is common practice however to ignore this distinc- 
tion and simply speak of £& itself as being linear. 
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Theorem 5-2. (Lerch’s theorem.)* Let f and g be piecewise continuous 
functions of exponential order, and suppose there exists a real number so 
such that £[ f(s) = &[g](s) for alls > 50. Then, with the possible exception 
of points of discontinuity, f(t) = g(t) for all t > 0. 


Thus whenever an equation 


£[y] = o(s) (5-5) 


can be solved for y, the solution is ‘essentially’? unique. In fact, if we agree to 
identify any two functions in ὃ which coincide except at their points of discon- 
tinuity, we can then speak of the solution of such an equation.t This solution is 
called the inverse Laplace transform of the function φ, and is denoted by £7 '[¢]. 
It is characterized by the property 


& Ne] = y ifandonlyif Φ[)}] = ¢. (5-6) 


At this point in our discussion only one general question remains unanswered ; 
viz., does ὃ map ὃ onto §? In terms of operator equations this is equivalent to 
asking if (5-5) has a solution for every function gin §. And this time the answer 
is an honest no, since we have 


Theorem 5-3. If fis a function of exponential order, then lims_,. &£[f] = 0. 


Proof. Indeed, in proving Theorem 5-1 we saw that there exist constants C and 
a such that 
C 


S—a@ 


ΘΓ] < 


for all s > a, and the desired result follows by taking the limit as s > oo. J 


On the strength of this theorem we can assert that such functions as 1, δ, sin δ, 
and s/(s + 1) do not have inverse transforms in δ, since none of them approaches 
Zero aS 5 —> ©. 


EXERCISES 


1. (a) Prove that the set & of piecewise continuous functions of exponential order is a 
real vector space under the usual definitions of addition and scalar multiplication. 


(Ὁ) Using the definition of addition given in the text, prove that the set § is a real 
vector space. 


* See Appendix II for a proof. 
{+ The knowledgeable reader will recognize that we are again defining an equivalence 
relation. 
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*2. Let fand g belong to 5, and define f ~ g if and only if f(s) = g(s) on some inter- 
val of the form so < 5. 
(a) Prove that ~ is an equivalence relation on 5. 
(b) Exhibit an equivalence class of functions in § which does not contain the Laplace 
transform of any function in &. 
(c) Can an equivalence class in ¥ contain two different functions which are both 
Laplace transforms of functions in &? Why? 

*3. Let S* denote the set of all equivalence classes of functions in F under the equivalence 
relation defined in Exercise 2. 
(a) Give an appropriate definition of addition and scalar multiplication for elements 
of S* so that $* becomes a vector space. 
(Ὁ) Define £*: ὃ — F* by L*[f] = LLf]*, where L[/]* is the equivalence class in 
$* containing the function £[f]. Prove that £* is a linear transformation. 

4. Prove that lim,_,,. s&[f] is bounded for any function f of exponential order, and 

then use this result together with Theorem 5-3 to deduce that £—![s*] does not exist 
for anya > —1. [Hint: See the proof of Theorem 5-3.] 


5-4 ELEMENTARY FORMULAS 
In Section 5-2 we used the definition of the Laplace transform to prove that 


L[cos at] = s> 0. (5-7) 


5 5 
52 + @q? 


In like fashion one can produce an almost endless list of elementary formulas, 
among which are 


gl] =< s>0, (5-8) 
| at I 
Me s> a, (5-9) 
£[sin at] = ae ’ s> 0, (5-10) 
£[t"] = es ? s > 0, a non-negative integer.” (5-11) 


For example, 
fe" 1: [ ot ρα ay 
0 


: to ες... 
= lim οὐ τ-οὖ dt 


tg—00 0 
— W@W ᾿ _ pap (8---αλὐέρ 
7 = ; =a ) 
S§S—@ 


* Recall that 0! = 1. 
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This proves (5—9), and (5-8) can be obtained from it by setting a = 0. Formulas 
(5-10) and (5-11) will be established presently, and a more comprehensive list is 
found in the table of transforms on p. 228. 

Although these simple formulas are not without significance, it is clear that any 
applications of the Laplace transform must rest upon more substantial results. 
One of the most important of these is a formula which expresses the transform of 
the derivative of fin terms of £[f] and the behavior of fat 0. This result in turn 
depends upon the elementary fact that any function which is continuous on (0, «), 
and has a piecewise continuous derivative which is of exponential order, is itself of 
exponential order (see Exercise 15). In particular, this allows us to deduce the 
existence of £[f] from the continuity of f and the existence of £[f’], and this is 
precisely what we need to prove 


Theorem 5-4. Let f be continuous on (0, 0), and suppose that f’ is piecewise 
continuous and of exponential order on [0, «). Then 


ΘΓ = 597] — fO*), (3-12) 


where f(0t) = lim:_.o+ f(t). More generally, if f, f’,...,f—» are con- 
tinuous for all t > 0, and if f™ is piecewise continuous and of exponential 
order on [0, 00), then 


[77 = s*S[f] Ξ 4(07) — f’(0*), (5-13) 

Sf] = sre f] — ππΊ 0 Ὁ) — s™-3f'OF) — ++ — κατ. 
(5-14) 
Proof. To establish (5-12) we use integration by parts to evaluate £[ f’]as follows: 


ef] = ” et FI) dt 
? οΌ 
=e "flo + sf εκ ΤῸ αἱ 
= s£[f] + e"fMlo . 
and the proof will be complete if we can show that e~“f()|f = —f(0*). 


To this end we note that since fis of exponential order, e~*‘ f(t) > 0 as t > o 
whenever s is sufficiently large. Thus e~*‘f(2)|> vanishes at its upper limit, and, 
taking account of the fact that f may have a jump discontinuity at the origin, 
we have 


εἰ F(Ho = lim e f(t) — lim e** f(t) 
ἐ-- γοο t—0 
= — lim εχ 
tot 


= ΞῚ (07), 


as required. 
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Formulas (5-13) and (5-14) can now be established by repeated use of (5-12), 
and we are done (see Exercise 28).* J 


EXAMPLE 1. Let f(t) = —(1/a)cosat. Then “(ἢ = sinat, and so, using 
(5-12) and (5-7), 


Ι 


5 I 
ΞΞ ἢ L[cos at] + με 


5 5 1 
intial +; 


s > 0. 


£[sin at] 


eee ee 
~ g2 4+ 2 
This proves (5-10). 
EXAMPLE 2. Since 215 = n!, (5-8) implies that 
£[D"t"] = Lfn!] = π| 91] = ὩΣ s>0. 


On the other hand, (5—14) yields 


£[D"t"] = s"g[t"] — s™71-0-—--- —0 


= s"*£[r"]. 
Hence s"£[t”] = n!/s for every non-negative integer n, and 


n! 


srt. s > 0. 


£f{t"] = 


This proves (5-11). 


With the mechanics of using the differentiation formulas now out of the way, 
we are in a position to illustrate the use of Laplace transforms in the solution of 
an initial-value problem. Our example must perforce be a simple one since our 
list of transforms is still rather limited. Nevertheless it will illustrate all of the 
essential steps of the technique. 


EXAMPLE 3. Use Laplace transforms to solve the initial-value problem 


αἴ" ‘ 
ΠΣ = 1s yO) = 0, γ(0) = 1. 


We begin by applying the operator £ to both sides of the given equation to obtain 


4[»] — £fy] = 91]. 


* A generalization of (5-12) to the case where f has jump discontinuities is given in 
the exercises below. 
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(Note that this step depends upon the linearity of £.) Using (5-13) and (5-8), this 
equation may be rewritten 


Pe] — 1 — ey) = Τ᾿ 


Thus 


1 
4{}] = C=) (5-15) 


and to complete the solution we must find a function whose Laplace transform is 
given by this equation. To do so we use the method of partial fractions to rewrite 
(5-15) as 

Ϊ Ι 
s—-l 5 


4{0}] = 
from which it follows at once that 
y=e— 1, 


The above example illustrates the way Laplace transforms are used to solve 
initial-value problems. In general, if we are given an nth-order linear differential 
equation Ly = A(t) with constant coefficients and initial conditions y(0) = yo, 
y'(0) = yi,..., 9" PO) = yn_i, then (5-14) can be used to convert this initial- 
value problem into an operator equation of the form 


Sly] = os), 
whenever A(t) is of exponential order. It then follows that 
y= £7"[¢], 


and the problem has been solved, provided £7 '[y] can be explicitly found. The 
reader should appreciate that this argument depends upon two facts: first, that 
the unique solution of every such problem is of exponential order, so that the 
existence of £[y] is assured from the outset, and second, that the equation 
y = £7 "[y] has a unique continuous solution. But both of these facts have already 
been established; the first in the paragraph following Definition 5-1, the second 
by Lerch’s theorem. 

We conclude this section by establishing the integral analogs of Formulas (5-12) 
and (5-14) which are frequently useful in computing transforms and their inverses. 


Theorem 5-5. Jf fis a function of exponential order on [0, 00), and a is a 
non-negative real number, then 


Ρ | / f(x) de = * ΡΠ _ : " ᾿ fx) dx. (5-16) 


190 THE LAPLACE TRANSFORM CHAP. 5 


More generally, 
t pt a 
ol ff seoae---ae] = Lan-2 J sora 
——— 
a t a t t 
ΞΕ [ταὰ-...--Ὁ} i ον [χοῦ dx ds 
s” 0 Ja SJo Ja a 


(n—1) times 


(5-17) 


Proof. The proof is based upon the observation that if fis of exponential order 
then so is f; f(x) dx (see Exercise 19). For using integration by parts with 


t 
ui) = [ f@)dx and dv = ede, 


[ctf σα 


— 1 uf f(x) dx 


we have 


4 F(x) ax 


ΠῚ e*' F(t) dt. 
0 S Jo. 


But since (ἡ f(x) dx is of exponential order, the first term in this expression tends 
to zero as t > o provided s is sufficiently large, and hence 


ff rear = otf] + : [ γαλᾶς 


Except for obvious notational changes this is (56-ἰ:6). Equation (5--17) is estab- 
lished by iterating this result. J 


In practice the integration formulas usually arise with a = 0, in which case 
they assume the much simpler forms 


4] [ | f(x) Ἢ Ξ  2[Π, (5-18) 


t t 
4 -f poyde--de| = Lain (5-19) 
0 0 
EXAMPLE 4. Since fj cos ax dx = (1/a) sin at, (5-18) gives 


πὸ 1 
5 Φ[51η at] = = L[cos at]. 
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Thus 
£[sin at] = - L[cos at] 


(Ga) 
s\s2 + a? 


a 
52 4+ a2. s> 0. 


EXAMPLE 5. Use the integration formulas to compute £[te 7]. 
Since 


: x t t 
[xe dx = te —e +1, 
(5-18) gives 
g[te’ — ε + 1] = 1 ete’) 
Using the linearity of &£ we then have 
£[te’] — fe] + Ll] = * ote’) 
Hence 
t I 1. ae ee 
416} ~~ ee | + 5 ς “161, 
and it follows that 


Ι 
£[te’] = G— iy’ s> 1. 


(The reader should note that this result can also be obtained by using the differen- 
tiation formula.) 


EXERCISES 


Find the Laplace transform of each of the following functions. (In those problems 
where it appears, a denotes a constant.) 


1. sin (¢ + a) 2. (t + a)? 3. (¢ + a)", na positive integer 4. sinh at 
5. cosh at 6. 126“! 7. sin? at 8. t2 cost 
9. ¢sin 21 10. (2¢ — 3)e@+2)/3 


11. Show that 


s(s” + 7) 


3 ——_— 8 
Sleos = GE NE FD 


12. Compute L£[e‘ sin 1]. [Hint: Use the differentiation formula.] 
13. Compute the Laplace transform of the function u,(t) defined by the formula 


u(t) = {» VS % 
1, Se 
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*14, 


15. 


16. 


17. 


18. 


19. 


20. 
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Compute the Laplace transform of the function whose graph is given in Fig. 5-3. 
[Hint: Recall the formula for the sum of a geometric series.] 


FIGURE 5-3 


Suppose that the function f is continuous on (0, ©), and that its derivative f’ is 
of exponential order. Integrate the inequality 


—Ce* < f"(x) < Cem 


to deduce that fis of exponential order. 
In the proof of Theorem 5-4 we used integration by parts to evaluate the integral 


[ “eo ΓΚ dt, 


where f’ was of exponential order. Prove that this was legitimate. (The problem 
consists of investigating the behavior of this integral at zero and at the points of 
discontinuity of f’.) 

During the proof of Theorem 5-4 it was asserted that e—**f()|9 vanishes at its 
upper limit provided s is sufficiently large. How large is “‘sufficiently large’’? 
Suppose that the function fin Theorem 5-4 has a jump discontinuity at to > 0. 
Prove that 


Lif] = s£ifl — fO*) — eT fts) — ΚΟῚ], 


where 
fd) = lim fo + A), fo) = lim fo — A), ἡ.» 0. 


Prove that [ f(x) dx, a > 0, is of exponential order whenever 7.15 of exponential 
order. 


Use (5-16) to prove that 


t pt : α , a pt 
4{- {κα τα κῶς. - [κα 


Solve each of the following initial-value problems using Laplace transforms. 


21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 


»" — 3» + 2y = 0; yO) = 3, yO) = 4 

γ᾽ + y Ξ τ; yO) = —1, yO) = 3 

»" + γ᾽ + 4ν' + 4y = —2; γ(0) = 0, WO) = 1, yO) = -Ι 
yl" — γ" + 9y' — Dy = 0; γ(0) = 0, γ'(0) = 3, γ΄ (0) = 0 

»" — γ — 6y = 347 + -- 1; yO) = —1, y’O) = 6 

»" + by’ + ὃν = 441 + 3); yO) = 2, WO) = —6 

ἅν + y = —2; γ(0) = 0, ν΄(0) = 3 

Derive Formula (5-14). 
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*29, If Ly = A(£) is a linear differential equation with constant coefficients and if π( ἢ 
is of exponential order, show that every solution of this equation is of exponential 
order. [Hint: Each solution is of the form y,(t) + y,(2), where y,(f) satisfies the 
homogeneous equation Ly = 0 and y,(f) = Ji G(t, HACE) dé. Recall how the 
Green’s function G(t, £) is constructed from solutions of Ly = 0 (see Section 4—S).] 
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As we have seen, the solution of an initial-value problem by Laplace transform 
methods comes down to finding the inverse transform of a function ¢(s). In prac- 
tice such inverses are obtained by using the method of partial fractions to convert 
y(s) to a form in which its inverse.can be recognized—usually with the aid of 
certain special formulas and a table such as the one given at the end of this chapter. 
In this section we shall derive a number of the above mentioned formulas, and 
illustrate their use in computations. 

We begin with a very simple result which permits us to compute the Laplace 
transform of e* f(t) whenever the transform of fis already known. 


Theorem 5-6. Jf £[f] = ¢(s), then 


£fe" f(D] = o(s — a). (5-20) 
Proof. 


I 


ste"fO] = [ * ee" F(t) αἱ 
[ “ε΄ το 4 FC) dt 


L[f(Ks — a) 
g(s — ἀ). ἢ 


This result is sometimes known as the first shifting theorem (the second will be 
given below), and may be written in terms of inverse transforms as 


£~"[o(s — a)] = eS "[o(s)], (3-21) 
Or aS 
£~"[o(s)] = ee "[o(s + a)]. (5-22) 


EXAMPLE 1. Since £ [cos 31] = s/(s? + 9), (5-20) yields 


s+ 2 


£fe—?" COs 3ῃ = (+2724 9 : 


EXAMPLE 2. Compute 


4.1} 2s + 3 |. 
52 — 4s + 20 
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Keeping (5-20) or (5-21) in mind, we write 


2s + 3 _ 2s + 3 
52 - 45 +20 (5s — 2)2 - 16 
_ As — 2) +7 
“Ὡς — 2) + 16 


-: 7 4 Ὶ 
7 Are — 2)? + πο + il ee ee | 


But 
(ges er eae 2 = e*' cos 41 
ς- 2+ 16}~° cos 41, 
and 
[| Cn a ee Lr At 
G@= Dea 16| © sin 41. 
Hence 


go! tg = 2e*’ cos 41 + 1653’ sin 41. 


In order to state our next result we must introduce the so called unit step function 
U,(t), which is defined by the formula 


0, t<a 
u{t) =~? "- = 
(t) 0. ea (5-23) 


(See Fig. 5—4.) (For our purposes we shall 
always assume a > 0.) This function en- 


ables us to write the formula for a function 
such as the sinusoidal curve 


0, t<a, FIGURE 5-4 


IQ) = va (t—a), t > a, (5:95) 


shown in Fig. 5-, in very simple form. Indeed, since μα(ῦ is zero for t < a, 
we have 


SM = μα(ῇ sin (t — a), (5-25) 


an expression which is much better adapted to computation than (5-24).* More 
generally, the expression 


Ug(t)g(t — a) 


-- t<a, 
ο΄ |g -- a), t> a, 


0 


* Some authors restrict the term “‘unit step function” to mean what we have called 
uo(t). In that case (5-25) becomes f(‘) = uo(t — a)sin (t — a). 
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FIGURE 5-5 


describes the function obtained by translating or “‘shifting’’ g(#) a units to the right 
and then annihilating that portion to the left of a (Fig. 5—6). Such functions arise 
in practice as time delayed inputs to physical systems (i.e., inputs occurring at 
time t = a > 0) and are of considerable practical importance. The next theorem, 
known as the second shifting theorem, gives a formula for the Laplace transform 
of such a function. 


FIGURE 5-6 


Theorem 5-7. Let 


f@ = u(dgtt — a, a2 


be a piecewise continuous function of exponential order. Then 
£[f] = e 215]. (3-26) 


(For physical reasons the factor e~** in this formula is known as a delaying 
factor.) 


Proof. LL] 


[ “6 "(Ὁ αἱ 


[ ᾿ e*"e(t — a) dt. 


Thus if we make the substitution x = ¢ — a, we obtain 
£[f] = [ e *4% a(x) dx 
0 
eo [ τ e °*9(x) dx 
0 


e [δ], 


and the theorem is proved. ἢ 
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To apply (5—26) in the computation of inverse transforms we rewrite it as 


ee“ [g()]] = ua(Dg(t — a), 
Or aS 
L~"fe~“y(s)] = ua(t)g(t — a), (5-27) 


where ¢(s) = L£[g(Z)]. 
EXAMPLE 3. If f(t) = u(t) sin 1, then 


᾿4{Π|Ξ L[ua(t) sin (¢ + a — a) 
= e *gfsin (t + a)] 
= e "£[sin tcos a + cos ¢ sin a] 
= e {cos ag[sin ἢ + sin ag[cos ἢ) 
_ e “(Cosa + 5 sina) | 
52 1 


EXAMPLE 4. Let f be the function whose graph is shown in Fig. 5-7. To compute 
£[ f] it is convenient to think of fas the sum of the functions 


l 
_ 40, t<l, 
falt) " τοῦ ie ds 
0, 2 
f3(t) ΠΣ a A f 
FIGURE 5-7 
Then 
£L[f] = effi] + L[ fo] + 4[2] 


: + e*g[—1] + e~* gf] 


5 + ο — a 
52 


EXAMPLE 5. Find ο΄ [ε΄ 35,Χ(2 + 6s + 10)]. 
Using (5-27) we have 


—3s 
᾿ς ἄς ΕΞ = us(t)g(t -- 3), 


where g(t) = ο΄ '{1/(s? + ὅς + 10)]. But, by (5-21), 


—1 I _ el l ᾿ς πϑέρ-|1 Ι _ ~—8t a: 
L πράτ 7 2 τετίτεη τ δυ ΕΞ ΕΣ ἜΠΗ 
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Hence 
—1 δ —3(t—3) (ὦ 
4 s? 4+ 6s + 10 = u3(t)e sin (t = 3). 


Our next result is somewhat akin to Theorem 5-6 in that it permits us to compute 
the Laplace transform of t" f(t) when £[ f] is known. Specifically, we have 


Theorem 5-8. Jf £[f] = ¢(s), then 
n n a” 
LO] = (— "ae, 96). (5~28) 
Proof. This result is established by differentiating both sides of the equation 
o(s) = | ef) dt 
0 


n times with respect to s. Thus 


£ os) = £ [ oF) αἱ 


᾿ ὁ —st 
Ι 5 le FO) αἱ 


= [ e*'tf(t) dt 
—L[tf@)], 


and so forth. (For a justification of this differentiation under the integral sign see 
Appendix I.) J 


l 


This time the companion formula phrased in terms of Ὁ. ὦ is 


_1| a” en ee 
ee Ε ") = (-᾿Ὄ᾿ 9 ἸΦΟ)}. (5-29) 
EXAMPLE 6. 
L[t sin ἢ = — £ Lfsin ἢ 
__d (a4) 
7 ds\s2 + 1 
2s 


“e+ 
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EXAMPLE 7. 


et’) = (1 & ot 


ev £() 


(--ὐ τ" 4 


ni 
= snd 


which again proves (5-11). 


EXAMPLE 8. Suppose we wish to compute £7 !{1/(s? + 1)?]. By comparing 
1/(s? + 1)? with (d/ds)(1/(s? + 1)) we see that 


ΕΝ 1 4{-1 ἡ. 
(s? + 1)2 25 ds \s2 + 1) 
and applying Formula (5-18) we have 


t 
ss τ + πη Δ αὐ yo 


But (5-29), with n = 1, yields 


or: ΙΖ (at) = =e" lol = —?fsint. 


t 
ἔνα ΕΞΞῚ = -3f (-t sin 1) dt 


t 
=| t sin t dt 
0 


= —$stcost + 2 51ὴ 1. 


Hence 


Our final formula is designed to reduce the computation of the Laplace trans- 
form of a periodic function* to the evaluation of an integral over a finite interval, 
and reads as follows: 


Theorem 5-9. Jf fis of exponential order and is periodic with period p, then 


ae t Lod (5-30) 


Φ[Π = 


* A piecewise continuous function f is said to be periodic with period p > 0 if 
S(t + p) = f@ for all values of ¢. 
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Proof. By definition, 
Sif] = δ e—*' f(t) αἱ 


(n+1)p 


+. ef) dt +++: 
We now set x + np = tin the (ἡ + 1)st integral of the above series to obtain 


ia est F(t) ΕΞ Γ. e ΤῊ ΠΡ) ἐ(χ ae np) Ae 
np 0 
-- a [ a ε΄.“ f(x) dx, 
0 
the last step following from the periodicity of f. Hence 
SLA] = fe f(x) de + ef" efx) dx + --- 
0 0 
ae ma i e—** f(x) ἀπ ee 
0 
—ps —2ps DP shige 
=fl+e +e eal ὁ f(x) dx. 


But the sum of the geometric series 
l+e 7% + see ft eo ΡῈ 4 aes 
is 1/(1 — e ”°), and it follows that 


ὍΠ - J = LO at, 


as asserted. ἢ 


EXAMPLE 9. Find the Laplace transform of the function whose graph is shown 
in Fig. 5-8. In this case fis periodic with period 2, whence 


“(Ὁ dt 
ΘΙ = Joe" f@) at — ΔῸΣ 
foe! dt 
1 — e—2s 


—S 


- 4 τ 

ο s(1 -- 6--39) 
Sass eee 
~ s(1 + e738) FIGURE 5-8 
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EXERCISES 
Find the Laplace transform of each of the following functions. 
1. ec” sin 3¢ 2. 3e ‘cos 21 3. f° sin 3: 
4. te’ cost 5. e τ cos (2t + 4) 6. te'(d/dt)(sin 21) 
7. το f(t) | 8. (D® + 1)f(2), where D = d/dt 
0 t<4 t, t<2 
9. ff) =)" 10. f(t) = 3° 
f Pee at 2, t>2 
τ 
0, ΐ « 5 
11. f() = sint, t < 20 12. f(t) = {cost, ~<t< ae 
0, t > 20 2 2 
37 
0, t> 5 
t, t= 2 | 
13. (Ὁ = (8 — 36 25153 14. sin f cost 
t—4 3<t<4 
0, t>4 
15. 262: sin ¢ cos ὦ 16. sin? t [Hint: What is the period of sin? 12] 
17. |sin ἡ 18. f(t), as shown in Fig.5—9 
t t t 
19. | te’ sin t dt 20. ra t cos 4t dt 21. af t sin t dt 
0 0 1 
et ae 
—t t 2t . 
22. ἜΠ e cos 31 αἱ 23. | er (ε΄ sin ἢ) dt 
24. Find the Laplace transform of the stair- 
case function 
fO =n +1, 


n<t<n+1, n=0,1,2,..., 


shown in Fig. 5-10. 


FIGURE 5-9 FIGURE 5-10 
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Find the inverse Laplace transform of each of the following functions. 


25, CED 26. ap 27. OTD 
28. ας τε 29. oa , a>il 
30. Cees > a,b constants 31. ote 
32. aa . 33. aT [Hint: See Example 8.] 
"34, τξτε 35. Σ᾿: [Hint: First expand in partial fractions.] 
3 —2s —s 
*36. are 37. wad 38. ἘΣ 
ik ened +. 25” + 1) — 242] 
40. a [Hint: See Exercise 35.] 
41. τ-- 42. ==> 
1 τ΄ 
43. sa 44. sae 
45. In 5 Ἔ 5. teint: © n 5 ἐς τς - SHRED Apply Formula (5-29).] 
46. In ines 


*47. Describe a procedure for finding the inverse Laplace transform of any rational 
function P(s)/Q(s), P, Q polynomials with degree P < degree Q. In particular, 
show that it is sufficient to consider the special cases 


(s2 + a2) (s2 + a2)” (s + a)” 


where a is a constant and vn a positive integer. 
*48. Show that for any integer n > 1, a ¥ 0, 


ΒΕ 1 a oe ae 1 
ἕ arora rare 


*49. (a) Use the result of Exercise 48 to show that 


- 1 1 A [ 
Ὁ Ε τ ρα om ghd t : t : t sin at dt dat dt. 
ed 


n times 


(Ὁ) Derive a similar formula for £—1[s/(s? + a?)"+1]. 
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5-6 THE LAPLACE TRANSFORM AND DIFFERENTIAL EQUATIONS 


The use of the Laplace transform in solving initial-value problems was introduced 
and justified in Section 5-4. In this section we shall illustrate how the formulas 
just derived allow us to solve more elaborate problems. 


EXAMPLE 1. Find the solution of 


yi +4’ 4+ l3y = 2t + 3e—7* cos 31, 


yO)= 9, y@O= -Ι. uN 


Taking the Laplace transform of both sides of this equation, and applying the 
given initial conditions, we obtain 


2 3 2 
sey] + 1 + 4590] + 1300] = = + eR: 
Hence 
ΝΕ Ι ip OO yale ns IE), 
OLY) - ore aaa 13 ay 1 13) 1 G2 4: 153} 


and we must now find the inverse transform of the various terms on the right- 
hand side of this equation. The first can be disposed of without difficulty since 


1 1 1/ 3 
see EH Gearas - eee): 
Hence 


τὼ - ππτάτα ΞΞ ae sin 31. 


᾿ To handle the second, we use the method of partial fractions, as follows: 


- ὃ AB, et 
s2(s2 + 45+ 13. 5. s2 ° s2 + 45 4+ 13 
whence 


As(s? + 45 + 13) + Bis? + 4s + 13) + (Cs + D)s? = 2. 
In order that this equation hold identically in s, we must have 


A+C= 
44+ B+ D= 
13A + 4B 
13B = 


we 


τῷ a 


td 


we 
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and it follows that A = — 785, B = 7, C = τὸς, ὃ = τῆς. Thus 
ee ree me 98 " 
5262 ++ 454+ 13) = 169\s 13 \s? 169 \s?2 + 4s + 13 
Ι 2 
J TB 


(Ὁ) + (Gear) 
s2) © 169 \(s + 2)2 + 9 


10 ( 3 ) 
᾿ς 3(1[69)Χλ( + 2)2 - 9 


Μετ᾿ 


and 
—1 2 oe ee ee 8 e—2! ags 3 20. e—*! gin 3 

4 52(s2 + 4s + 13) = -- τῆς + st + reve COS δὲ — #07 e sin 3f. 
Finally, since 

᾿ς 3(s + 2) τ 1 

(52 + 4s + 13)? ds \s? + 4s + 13 
d (ς-τ ὐτ το] ; 
ds \(s + 2)? + 9 
we can apply Formulas 5-21 and 5-29 to obtain 


οὶ ΕΞ. = dte—** sin 31. 


Combining these results we see that the solution of (5-31) is 
y = —b8e7*' sin 31 + y85e 7! cos 31 + Ste? sin 31 + 2.1} — τ8ς. 


(The student who feels overwhelmed by the details of these computations is 
urged to compare them with those involved in the method of variation of param- 
eters or undetermined coefficients. He will find that the argument given above is 
simpler and much more straightforward than either of the other two.) 


EXAMPLE 2. In this example we show how the method of Laplace transforms 
can be used to find the general solution of a differential equation. As an illustration 
we again solve the equation 


(D — a)*y = 0, (5-32) 


where ἃ is an arbitrary real number. 

In the absence of specific initial conditions we choose them arbitrarily as 
yO) = cy, γ (0) = ceo. Taking Laplace transforms of both sides of (5-32) and 
applying our initial conditions, we have 


s*£[y] — cys ~ cg — 2a(s£[y] — οι) + a? £[y] = 0. 
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Hence 
C15 + C9 + 2ac 
£b] = 52 — 2as + a? 
_ ¢18 — Cia ru Co + 3c1a 
(s — a)? (s — a)? 
SO (ent Seige εἰ 
sS—a (s — a)? 
But 
451} : | = οἷ and e| | = te’ 
S—a ; (s — a)? 
Hence 


y = ce + (02 + 3c 10)te*' 


πὸ c3e™* + cate’, 


where 65, (4 are still arbitrary, is the general solution of (5-32). 


EXERCISES 


Solve each of the following initial-value problems using Laplace transforms. 
1. (}5 + 2D + τὴν = εἰ; yO) = γῸ) = 0. 


2. τ + 3y = tsinat; γ(0) = —1. 


d’y dy 
---- --.-..- = © = / = ) 
3: 2 + 2 7 + 3y = 3t; y(0) = 0, γ΄(0) = 1. 


4. (D® — 4D + 4)y = 2.2 + cost; y(0) = #&, (0) = -- Ὃς. 


FIGURE 5-11 


5. o + ky = h(t); γ(0) = 0, with k a constant and the graph of A(t) given by 


Fig. 5-11. 
2 
d y dy ἐ - t 
i evens — _ —= μή = -- 0. 
6 ΠΣ 2 Hh + y te sin t; y(O) γ΄ (0) 


10. 


11. 


12. 


13. 


14͵ 


15. 


Ἐ16. 
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ἂν -- ἂν + 4 — 4y = —3e' + 4e”’; y(0) = 0, (0) = 5, y"(0) = 3 
‘de = (2 dt ; ἌΝ 
d‘y d°y d’y dy , ” mt 
a tap tae 354, Ὁ Ξ" γ0) = YO =» (0) = y"(O) = 0. 
d° d 0, t< 2; 
ἀ τά εν -] = y(0) = 1, γῸ) = --. 
ἘΞ t> 2; 
2 
τ +y =f? +1; yr) = π΄, γα) = 2π. [Hint: First make the substitution 
χτί-- πὶ 
d’y - ἢ ΡΟ : 
ee —10 sin 2t; yr) = —1, y’Gr) = 0. [Hint: See Exercise 10.] 
«ἢ 0, t<1; 
EY yy = Ξ 1; yay = ya) = 1, γὮὋ = γῆ) = 0. 
t—1, t>1; 


[Hint: See Exercise 10.] 
Use Laplace transforms to solve the equation 


4 t f, bel, 
® +4 woa=j2-4 l<?rs 2, 
at 0 

0, t > 2, 


subject to the initial condition y(0) = 1. | : 
(a) Suppose that γ( is of exponential order and is a solution of the Euler equation 
2 

ady dy = 

t ΠΣ + a + ὃν = 9% 
a, 6 constants. Show that £L[)(d] also satisfies an equation of the Euler type. 
(b) Prove that the result in (a) is also valid for any solution (of exponential order) 
of an Euler equation of order zx. 
Show that if f(‘) and f’(#) are of exponential order, and if f(#) is continuous for all 
t > 0, then 


lim s£[f] = f(0*). 


Bessel’s function of the first kind of order zero, denoted Jo, is by definition that 
solution of the differential equation 


2 
dy ὧν = 

prea a me 

which is defined for ¢ = 0 and satisfies Jo(0) = 1. Prove that 


1 


Vil Τα 


ΒΙΜΟΟῚ = 
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[Hint: Show that £L[/o] is a solution of the differential equation 
(1 + s?)y’(s) + sp(s) = 0, 


and use Exercise 15. Assume Jo is of exponential order. ] 
*17. By expanding s£[Jo] = s(s? + 1)~—1/2 (see Exercise 16) in a binomial series, express 
Jo(t) as a power series. 


5-7 THE CONVOLUTION THEOREM 


In this section we shall establish the most important single property of the Laplace 
transform, the so-called convolution formula. Far from being just a computational 
device, as were the results of Section 5—5, the convolution formula plays an im- 
portant role in certain theoretical investigations in advanced analysis. And in 
the following pages we shall find that it is also ideally suited to the task of con- 
structing inverses for linear differential operators with constant coefficients. 

We prove the formula in question as 


Theorem 5-10. Let f and g be piecewise continuous functions of exponential 
order, and suppose that 


LLf] = φῶ), L[g] = ys). 
Then 


t 
£| [ff — de) dé] = vfs). (5-33) 
0 
When written in terms of inverse transforms, (5-33) becomes 
t 
£ Toso] = [ fa — Ds) dé, (5-34) 
and in this form asserts that if we know the inverse transforms, f and g, of the 
functions φ and ψ, we can express the inverse transform of the product ¢(s)y(s) as 


an integral involving fand g. The integral in question is called the convolution of 
fand g and is denoted f * g; that is, 


("εγὼ = [Λα — De® db. (5-35) 
Using this notation, (5-34) can be written 
fg = &[o(WG)], 
or, even more suggestively, 


Θ᾽ ΠΡΟ ΨΩ) = £~'Ie(3)] * 9. "YG. (5-36) 
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Proof of the theorem. Using the definition of £ we have 
t _ ost t = 
s|f se — De@de|= [4 Κι -- Date) dk at 
o st εἰ 
=f[ [era -- De de dt, 
0 Jo 


where the integration is being performed over the region of the té-plane described 
by the inequalities 


(see Fig. 5—12). But this region is also described 
by 


E<t< ow, 0O< E< ~w, 


and hence the above iterated integral may be 
written 


Ἂ [Γ e~*"f(t — £)g(é) αἱ dé, 


Or 


οὐ ; fo 2) = : 
[ g(é) (J. ο΄ f@ — ὃ dt) dé.t FIGURE 5-12 
We now make the change of variable u = ¢ — ξ ἴῃ ff e~* f(t — ὃ dt and obtain 


[ “eet — ὃ αἱ = [ “6 "τ Fy) di. 


Hence 


e| fr — θεῷ «ἡ = [εκ (few du) ae 
= [ * oak) ( [ ” e—* F(u) du) dé 
[τὼ dul” e*g(e) ἀξ 


0 
ΦΙΠΡΙΣΙ, 


and the proof is complete. ἢ 


The operation of convolution can be viewed as a multiplication on the vector 
space ὃ, with f * g as the product of fand g, and it is of some interest to determine 
its properties. For instance, Formula (5-34) and the equality £[f]£[g] = L[g]L[f] 


} It can be shown that an interchange of the order of integration is permissible at 
this point. See Appendix I. 


208 THE LAPLACE TRANSFORM CHAP. 5 


imply at once that 


[δα -- θεῷ ἀξ = [ et — OF ab. 
0 0 


Hence f * g = g * f, and convolution is a commutative operation. It is also 
associative and distributive; that is 


fe(exh=(F*a*h and f*(et+h=frgtfrh 


(see Exercises 14 and 15 below), and thus defines a very reasonable multiplication 
on & Much of the advanced work connected with the convolution integral is 
devoted to studying the behavior of & under this multiplication. 


EXAMPLE 1. Find 
“(52 + 1) 


It is clear that this problem can be solved by separating 1/(s(s? + 1)) into 
partial fractions as (1/s) — (s/(s? + 1)) and applying our earlier formulas. But 
it can also be handled just as well by using (5-35) and (5—36) as follows: 


[1|. .-α 1 | 
: bee zn 
1 * sint 


[sin eae 


1 — cost. 


= 1 
ἃ ice + 5 


EXAMPLE 2. Find the solution of the initial-value problem 


(D? + D — 6)y = h(?), 
yO) = YO) = 9, 


given that h(t) is a function of exponential order. 
We apply the operator £ to the given equation and obtain 


(5-37) 


(s? + s — 6)£[y] = Lf], 
or 
4[ἢ 
“l= ας τὸ 


9 


from which it follows that 


ex 1 
Ua ἰς —He + τ ne): 
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But since 
obabsl--bets-x 
(s — 2)(s + 3 S(s— 2) Ss + 3) 


2t —3t 
= ξε΄" — te”, 


we have 


y= f ‘ phe2t—P — £e-3(-Oyn(e) ἀξ, (5-38) 


and the problem has been solved pending explicit knowledge of h. 
If, for example, A(t) = 1, then 


t 
y [ [1ε2“- - be 5(-) ἀξ 


t t 
be?! [ et dt — Sane [ est ἀξ 


2t —3t 
roe"! + rset — ἢ 


The reader will recall from Section 4—5 that the function K(t, § = ξε2 Ὁ — 
2e—3(t—®) appearing in (5-38) is called the Green’s function for the linear differ- 
ential operator L = D? + D — 6 (for initial-value problems at t = 0), and as 
such completely determines an inverse for L. In the next section we shall have 
more to say about the simple formula 


Gt, ἢ) = £7 aaissl ( — ὃ) 


which allows us to compute this Green’s function by Laplace transform methods. 


EXERCISES 


Use the convolution formula to find the inverse Laplace transform of each of the following 
functions. 


1, SUL , 4 afl ,. ree 
52 + 1 : 59 ᾿ s2(s + 1) 
s 35° 1 
* @F1p - @ +P “Goae-h 7%? 
Evaluate each of the following. 
7. et « et 8. ἐπ cos at 
9. sin at * cos bt 10. ¢t * e% 


11. f@@ — 1) *e~*g(t + 1) 12. 73(-- ἢῤ * (sin Dg(t?) 
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13. Prove directly that f * g = gx f, that is, 


[ se - θείας = [κα - DAA. 
0 0 


[Hint: Make the substitution u = ¢ — &.] 
14. Prove that ἔκ ( + A) = faegot fea. 
15. Prove that f* (g*h) = (f*g) */h. 
16. Find 1 * 1 and 1 «1 «1. 
17. Derive a formula for 1 * 1 *« 1 *--.+*1 ( factors). 
18. Prove that 


t Uy ug 
| sin a(t — ὦ sin a(u, -- | sin a(ug — u3)°*° 
0 0 0 


Un—-1 
SIN A(Un—1 — Un) SIN Alyn dun+ ++ duy 
0 


Α- ἐ ἑ t t 
Qa Ε 
= | | if | tsin αἱ dt::-:dt. 
2n! Jo Jo Jo 0 


YS” 


n times 


[Hint: Compare £~'[1/(s2 + α2).1] as computed by the formula of Exercise 49, 
Section 5-5, and as computed by repeated use of the convolution integral.] 


19. Suppose that f(#) is of exponential order and that lim,_,9+ f()/t exists. Assuming 
that the order of integration may be reversed in the computation, prove that 


Ὁ “ἢ LL f] ds. 


Use the result of Exercise 19 to compute the Laplace transform of each of the following 
functions. 


2 : 
ak : 2. 2 sin at 
20. (- Fs with [1] = 3) 21. ; 
t 
22. e —1 23. 1 cos 3f 
t {2 


24. (a) It can be proved that whenever f, ὃ [7] dt exists, the formula in Exercise 19 
remains valid with s set equal to zero. Show that we then obtain 


[ @a-{ LL f] ds. 
0 t 0 


(b) Use this formula to prove that 


2 e 
sin ὦ τ 
| ~—— dt = =: 
o ὦ yd 


The Gamma function T (x) and Beta function B(x, y) are introduced in Exercises 25-33. 


25. 


26. 


27. 


28. 


29. 


30. 
31. 


32. 
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The gamma function is defined by the equation 


T(x) = | et" dt. (5-39) 
0 


(It can be proved that this integral converges for all x > 0.) Use integration by 
parts to show that 
C(x + 1) = x) forallx > 0. 


Use the result of Exercise 25 together with the value of I'(1) to prove that 
Tan + 1) =n!, n=0,1,2,.... 


(Because of this property the gamma function is also called the generalized factorial 
function.) 

By differentiation of (5-39), show that I’’’(x) is non-negative on (0, ©). Where, 
approximately, does the minimum of I(x) lie? Draw an accurate graph of I(x). 


Let n be an arbitrary real number greater than —1. Prove that 


| Hint: Set ¢ = u/s in the integral defining L[t"].] 
Prove that (4) = x. [Hint: Show that 


Γ() = 2 " ε΄“ du, 


1\ |’ i ere 
ΓῚ = = 4 e du dv. 
2 0 Jo 


Now evaluate this integral by changing to polar coordinates.] 
Find the value of P'(). (See Exercise 29.) 
Evaluate each of the following integrals. 


ο΄ ᾿ _Vz 
(a) [ ie dx (b) [ e dx 


Prove that 


and hence that 


1 
T@NG) _ | ee 
ΤᾺ Ἐν) Jo” ee 


whenever x, y > 0. This integral is known as the Beta function of x and y and is 
denoted B(x, y); that is, 


1 
BO, y) = [ μ 1( — μὴν 1 du. 


[Hint: Use the result of Exercise 28 and the convolution formula to evaluate 
&—1[1/s*+4] in two ways.] 
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33. Use Exercise 32 to prove that 


| "de vr Td/n) 
0 


View π Ti+ 2)/Qn) 


*5-8 GREEN’S FUNCTIONS FOR CONSTANT COEFFICIENT LINEAR 
DIFFERENTIAL OPERATORS 


We begin this section by recalling a number of facts concerning linear differential 
operators which were established in Chapters 3 and 4. 

Let L = δ + a,_1()D"—! + --+ + ao(t) be a (normal) linear differential 
operator whose coefficients are continuous on an interval J, let ἢ be continuous on 
1, and consider the equation 


Ly = h(t). (5—40) 


Then ἢ can be viewed as a linear transformation from @"(J) to C(J), and a solution 
of (5—40) can be described as a linear transformation G from C(/) to C"(/) which 
acts as a right inverse for L, i.e., is such that L(G(h)) = h for all hin@(/). In the 
absence of any further conditions on the unknown y, Gis not uniquely determined 
by LZ since L is not one-to-one. Thus to construct G we must impose a sufficient 
number of additional restrictions on y so as to make the solution of (5—40) unique. 
For example, we might require, as in Section 4—4, that y be the solution of (5-40) 
which satisfies the complete set of initial conditions 


γ( 9) = (to) = °° = γῆ (9) = 0 (5-41) 


at some point fo in the interval J. Then the corresponding inverse G can be ex- 
pressed as an integral operator 


Gn) = [ Κα, On(E) ἀξ, (5-42) 


where the function K(t, ) may be constructed by the method of variation of 
parameters from a basis for the solution space of Ly = 0 [see Formulas (4-30) 
and (4—42)]. This function is called the Green’s function for L for initial value 
problems on I, and is completely determined by L since we saw that it 15 independent 
of the point ἐο at which the initial conditions were imposed and of the particular 
basis chosen for the solution space of Ly = 0. 

In this section we shall rederive several of the above results in the case of a 
constant coefficient operator L by means of the convolution formula. One of the 
principal advantages of this method is that it allows us to bypass the explicit use 
of a basis for the solution space of Ly = 0, and eliminates the tedious computa- 
tions involved in the method of variation of parameters. As such it furnishes an 


5- Ϊ GREEN'S FUNCTIONS FOR CONSTANT COEFFICIENT OPERATORS 213 


excellent example of the efficiency that accrues from using the “coordinate free’’ 
ideas of linear algebra. 

Thus, for the remainder of this discussion we shall consider the constant coeffi- 
cient linear differential operator 


L = ἢ" + a,1D""' +--+ + ao, (5-43) 
and we begin by solving the initial-value problem 


Ly = h(t), 


y(0) == y’(0) wes) Gs y"—-Y0) ἘΞ 0, (5-44) 


where /A(f) is a function of exponential order. Applying the Laplace transform ὦ 
to (5-44), we obtain the equation 


p(s)£Ly] = h(s), 
where p(s) = 55 + an_ys™ 1 + +++ + ao, and A(s) = £[A]. Thus 
_ As) , 
*b1 = τῷ 


and hence if 


Ταῖς ΕΠ = g(t), 


the convolution formula yields 
t 
y(t) = f a(t — One) de (5-45) 


as the desired solution of (5—44). 

We can now view (5-45) as determining, in the usual way, a mapping from 
C[0, «) to C”[0, oo), and we have therefore obtained a right inverse G for the 
operator (5-43) on this interval.* The defining equation for G is 


Gh) = [se — Ome ἀξ, - (5-46) 


and the function g(t — £) appearing in this integral is then, by definition, a Green’s 
function for LZ for initial-value problems at t = 0 (see Definition 4—2). 
Fortunately we can say much more about g(t — &). For the function 


Κῶ = oT 


* In Exercise 14 it is shown that (5-46) can be derived, using Laplace transforms, 
without the assumption that μά) is of exponential order. 
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is the unique solution on [0, «) of the initial-value problem 
Ly = 0, 
y0) = ¥O = ++ = y*-?@) = 0, (5-47) 
y*-VO) = 1, 


as is easily verified by using Laplace transform methods to solve (5-47). (See 
Exercise 12.) Moreover, the usual techniques of Sections 5—4 and 5-5 for com- 
puting £~*[1/p(s)] lead to a function K(t), which extends g(t) to the unique solu- 
tion of (5-47) on all of (— 0, οὐ). Thus by Theorem 4-3, K(t — ξ) is the Green’s 
function for L (for initial-value problems) on the entire interval (— 0, οὐ). When 
Laplace transforms are used in a purely computational fashion it is common prac- 
tice to ignore the distinction between K(f) and g(t), as we do, for example, in 
stating the next theorem which summarizes the above results. 


Theorem 5-11. Let L be the constant coefficient operator (5-43), and let 
P(s) = 55, + an_is™—*> + +++ + ao 


be the auxiliary polynomial of L. Then if 


g(t) = Ο΄" Pat 
the function g(t — ὃ) is the Green’s function for L on the interval (— οὐ, 0). 
EXAMPLE 1. To find a Green’s function for the operator 
L= D? —2aD+a’?+ b?, b#0, 


we first set 


I 


4 I 
8() -- ὃ ae 


= 1 
. 5 a) ταὶ 


| ore 
5° sin bt. 


Then, by the above theorem, the desired Green’s function is 
g(t — ὃ) = Ta sin b(t — £). 


EXAMPLE 2. Find the particular solution of the differential equation 
(4D* — 405 + 5D? — 4D + 1)y = Int 


which satisfies the initial conditions y(1) = γ({) = γ΄ (1) = γ΄") = 0. 
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We first use Theorem 5-11 to compute the Green’s function for 


L= D‘— D?4+8pD?— D+ 3. 


g(t) = ο΄" πεσεῖν στη 


561 — 58 + 3522 - οὶ +3 


Since 


το ἀετοὶ 
(25 — 1)2(s? + 1) 
οἰ αν τ - oh + aH - AB] 
Qs — 1)? 2s—1 ° s?+ 1 s2+ 1 
= #re/? — £60"? 4 16 cost — 42 sin t, 


the desired Green’s function is 
g(t — ὃ = ξ( — el P/? — p8eHl2 4 18 cos (t — ὃ) — 18 sin (( — ὃ). 


The solution of the given initial-value problem can now be written in the form 


t 
In 
v= f ae — 9a 
| 1 
since A(t) = (In t)/4 is the right-hand side of the normalized differential equation 
(D* — D® + 2D? — D+ dy = Int. 
As a final example let us use Green’s functions and Laplace transform methods 
to solve an initial-value problem with nonhomogeneous initial conditions, say, 
Ly = h(t): 
: οὐ 1) (5-.48) 
γ( 0) = COs, ee. 4} (19) = Cn_}. 


Following the methods of Chapter 4 we can write the solution of (5-48) in the 
form 


Y= Vh ἘΝ G(h), 


with G(h) as above, and y, the solution of the homogeneous equation Ly = 0 
which satisfies the initial conditions of (5—48). 
If, for example, (5-48) is 
(D? — 2aD + a? + by = κ(ῦ, 
y(r) = Pap 7 (x) -" = 5, 


then, using the Green’s function for D? — 2aD 4+ a? + b? obtained in Example 1, 
we have 


(5-49) 


t 


G(h) = ; / e'— sin b(t — £)h(E) ἀξ. 
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Thus it remains to find the solution y,(¢) of the initial-value problem 


(D? — 2aD + a® + b*)y = 0, 
Wr) = 24, yr) = —3. 


This, of course, may be done with the methods of Chapter 4. But we can also 
use Laplace transforms if we note that ya(t) = y(t — 7), where y(f) satisfies 


(D? — 2aD + a? + b*)y = 0, 


(5-50) 
y0) = 2, yO) = —3. 
Applying £ to (5-50) we obtain 
(s? — 2as + a? + b*)£[y] = 25 — 3 — 4a, 
or 
2s — 3 — 4a 
SDI = 2 tas + a? + δὲ 
— Wa _ 34+ 2a. 
(5 -- ΩΣ - 2. (s — a)? + B? 
Thus 
y(t) = 2e%' cos bt — 38 sin bt, 
and 
PCa oa ne me 2 ἘΠ νυ. + 55 sind 2 |: 


The desired solution of the original problem is now completely determined as 


y= ἢ Ε cos b(t -- x) -- 5178 sin b(t — | 


t 
Be Ὥ et'—®) sin b(t -- ξ)μ() ἀξ. 


EXERCISES 


Determine Green’s functions for each of the following linear differential operators in 
three ways: (a) by applying Formula (4-42) or (4-43); (Ὁ) by applying Theorem 4-4; 
and (c) by applying Theorem 5-11. 


1. D2? —4D+44 2. D?+ D 3. D? + 6D+ 13 — 
4. D2+4D—4 5, D2? —~1D+ 2 6. 4D3 — D 
7. D3 +1 8. (D2 + 1)? 9. Dt +1 


10. (D? — 4D + 20)? 


11. 


12. 


13. 


14. 


15. 
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Solve the initial-value problem 


ωὐ — ny = {° O<?t<1, 
ἐ τ 1, t>1, 


y(0) = yO) = 0, 


in three different ways: (a) by using Laplace transforms directly; (b) by first deter- 
mining a Green’s function for D* — 1; and (c) by solving the initial-value problem 


(D?-)y=t-1; ydH=a yQd=s, 


with an appropriate choice of constants a, b. 


Prove that the function g(f) = £—1[1/p(s)] defined in the text satisfies the initial- 
value problem 
Ly = 0; 
yO) = +++ = yO") = 0, yD) = 1, 


on the interval [0, ©). 
Show that the methods of Sections 5-4 and 5-5, when used to compute £—1[1/p(s)], 
lead to the unique solution on the entire interval (— ©, ©) of the initial-value problem 
of Exercise 12. (This justifies the statement that g(t — ξ) is the Green’s function for 
L on (—&, ©), where g(t) = £![1/p(s)].) 
Use Laplace transforms to derive (5-45) for any function A(‘) which is piecewise 
continuous on [0, 90). [Hint: First consider the solution of (5-44) with A(t) replaced 
by 

H(t) = ΩΝ 0<t<a, 

0, t> a, 


where a is a constant > 0.] 


If L is a constant coefficient operator, show that y,(4) is a solution of the initial- 
value problem 
Ly = h(Q); 


y(to) = co, (to) = δι, ..., γῆ Ὀ() = cn—1, 
if and only if y,(4) = Y(t — to), where Y(t) satisfies 


Ly = h(t + 10); 
y0) = co, yO) =c1, ..., y*-PO) = cn_1. 


Solve each of the following initial-value problems using the method given at the end of 
this section. 


16. 
17. 


(D? + ly = e-1!; yl) = γῇ = 0 

(2D? + D — 1ὴν = sint; γα) = y'@) = 0 
(4D? + 16D + 17)y = 1? -- 1; y@ = y'@ = 0 
(D? — 3D — Ὃν = εἴ; y(2) = 3, y'(2) = O 
(2D? -- 30 Ὁ τὴν Ξ ἡ; yA) =0, Y= —-1 
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21. (4D? — 4D + 37)y = οἰ" cos3t; y(@) = 7, Y@ = —2,a > 0 
22. (D? + ly = te’; yO) = WO) = 0, γ΄) = 1 
23. D2(D? + 1)2y = AQ); y¥@ = Y@ = γ΄ (ἃ = γ""(ὦ = YY @ = 0, YP@ = 1 
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Consider an elastic spring which is fixed at one end 
and is free to vibrate in a vertical direction as 
shown in Fig. 5-13. Suppose a weight of mass m 
is attached to the spring and the entire system 
comes into equilibrium with the weight at the 
point y = Ο located yo units below the natural 
length of the spring. Then, by Hooke’s law, the 
weight experiences an upward force of magnitude 
kyo.* Since the system is in equilibrium this force 
is exactly counteracted by the force of gravity 
acting on the weight, and so we have 


kyo = meg. (5-51) FIGURE 5-13 


Suppose that the spring-weight system is in equilibrium, and that the weight 1S 
now subjected to an additional vertical force h(t) which may vary with time. Then 
at time 1, with the weight a distance y(t) from the equilibrium position, and the 
positive y-direction measured downward, the forces on the weight are mg due to 
gravity, —k(y — yo) due to the restoring force in the spring, and A(t). Hence, 
by Newton’s second law, we have 


2 
m2 = mg — ky -- yo) + Ad) 
or, using (5-51), 
ΕΣ. + ky = h(t) (5-52) 
dt? 


Furthermore, since the system was initially at rest in equilibrium, y(7) must satisfy 
y0)= Ὁ, yO) = 9, (5-53) 


and the motion of the weight is thus obtained as the solution of an initial-value 
problem. 
To solve this problem we use Laplace transforms and obtain 


ms*£[y] + ΚΘΙΡ] = £[A(d]. 


* The positive constant k is known as the spring constant. It depends upon the ma- 
terial from which the spring is made, the dimensions of the spring, etc. 
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Hence Lfh 
9} = ea k : (5-54) 


and 


yo) = ot] Sh | + a0 


—1 V k/m | th 
se Ξ mk (s? ++ (k/m)) 


= (4 sin " : ἡ * h(t). 


Thus the equation of motion for this system under the action of an arbitrary ex- 
ternal force ἡ can be expressed in integral form as 


y(t) = oni [ sin[Vk/m (t — ξ))μ(ξ) dé. (5-55) 


In applications the impressed force A(t) is often of the form 
h(t) = Asin ot, (5-56) 


where A and w are positive constants, in which case the equation of motion 
becomes 


y(t) = om [ sin[Vk/m (t — &)] sin wé dé. 


Although this integral can be evaluated by elementary techniques it is instructive 
to begin again with (5-54) and solve the problem directly. Thus 


] 
59] = ms2 +. k 
1 Aw 


es —__.______—_—___ # 


~~ ms? + k 55 + w? 


[A sin wf] 


We now consider two cases according as ὦ is or is not equal to »/k/m. 


Case 1. w A WVk/m. Then Aw/[(ms? + k)(s? + w?)] can be rewritten by the 
method of partial fractions as 


_4o (_ 1 πι Δ 
k — mw? \s2 + w?2 ms2 + k 
+ Those of our readers who are familiar with the material of the preceding section will 


recognize that we have now computed the Green’s function g(t — ¢) for initial-value 
problems involving the normalized operator L = D? + (k/m), and that 


ett — ὃ = Vm/ksinVk/m(t — ὃ). 
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y=2 sin¢t — sin 2¢ 


FIGURE 5-14 


and, taking inverse transforms, we obtain 


y(t) = oe Ξ sin wt — /m/k ϑιὴ ν Κ] πὶ 1 (5-57) 


This function may be interpreted as the superposition of oscillations of two 
different frequencies, «/k/m 27 and w 27. The first of these is the so-called natural 
frequency of the system, while the second is the frequency of the impressed force 
(5-56). In Fig. 5-14 we have sketched the graph of y(t) whenm = k = 1,A = 3, 
and w = 2. 


Case 2. w = VW/k/m. Then 
Av/km 
£01 = Gas? + bP 
= Av km 5 


a ey Θσασ ΟΣ ΩΡ ΞΘΣΊΝΕ: 


5 (ms2 + k)? 


ai). 83 lee πῶς Oh wf ἰὸς 
᾿ ΕΞ τ, >| a Im ds (3 a 2) | 
1 4f 1 

2m a πε Ἔ ‘| 


ΐ ᾿ 
= ——— sinVk/mt, 
2mvV km 


But since 
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6 y= 3sint—}¢tcost 
5 
4 
3 
2 
π 3π 4π ᾿ 
-4} 
-2 
-3 
Ξ 
5 
τό FIGURE .5-15 
the convolution formula can be used to obtain 
t 
y= cal ξ sin V/k/m ξ ἀξ 
= A | sin νέαι -- Vinfk tos Vk/m t} 
and we have 
y(t) = Ξ sin /k/mt -- i tcos V/k/m t. (5-58) 


Therefore when the impressed frequency is equal to the natural frequency, the 
amplitude of the oscillations increases with time and the spring is eventually 
stretched beyond its elastic limit (see Fig. 5-15, sketched for A = k = m = 1). 
This phenomenon is known as resonance, and is important in various physical 
problems. ¢ 

A rather different situation arises if we attempt to find the response of this sys- 
tem when the weight is struck a sharp blow in the vertical direction at time t = a, 


t Also see the discussion of resonance in connection with electrical networks in 
Section 4~10. 
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a > 0. To obtain the equation of motion in 
this case we introduce the function ἢ defined 
by 


0, O<t<a, 
A(t) = , a<t<a-+rT, (5-59) 
0, ατ τ Ξ 4, t 
where 7 is an arbitrary positive constant (see FIGURE 5-16 


Fig. 5-16). Physically, ἢ represents a force of 

magnitude 1/7 acting on the system for a time 7, and hence ἢ imparts a total im- 
pulse of 1 to the system.* We now agree that the mathematical description of the 
physical situation described by the words “sharp blow” is obtained by using a 
force which acts throughout an arbitrarily short interval of time but imparts a 
predetermined impulse, or change of momentum, to the system. Our problem 
then becomes that of determining the behavior of the solution y(t) in (5-55) 
when ἡ is as above, and τ — 0. 

Substitution of (5-59) in (5-55) gives 


0, O<t<a, 


t 
y(t) = Ἢ] τὰς sin Vk/m (t -- 6] di, a<t<a+t+r, (5-60) 
= bya 


a+r 
tf |. sin Vi7m ( ~ θ᾽ ας Po eee 


m 


Hence, passing to the limit as 7 — 0, we obtain the solution 


0, t <a, 


= 5-61 
volt) Jasin Vk/m(t — a), t > a, ί : 


(see Exercise 2). But γο(ῦ is also the solution of the initial-value problem 


d°y ode 


l 
, = 9 
γ(α) --ἰο, γί) -τπ' 

* A constant force of magnitude F acting on an object of mass m for 1 seconds is said 
to impart an impulse I = F-t to the object. Since F = (d/dt)(mv), where v is the magni- 
tude of the velocity of the object (Newton’s second law), it follows that when F is constant 
the total change in the momentum mou of the object is equal to the impulse. Throughout 
this discussion we shall assume for the sake of convenience that J = 1. 
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and as such can be interpreted as the response of a weighted spring which is given 
unit momentum at t = a [i.e., my’(a) = 1], and left undisturbed thereafter. It 
follows (see the preceding footnote) that in this situation yo(t) may be interpreted 
as arising from an instantaneous unit impulse imparted to the system at ¢ = a, 
and the problem has been solved. 

In certain circumstances it is convenient to think of such a unit impulse at t = 0 
as arising from a fictitious function 6(f), called the Dirac Delta Function, whose 
defining properties are 


s(t) = 0 for allt ¥ 0, | ” 6(t) dt = 1. (5-62) 


In these terms a unit impulse at t¢ = a would be provided by the “function” 
6(¢ — a). The initial-value = leading to (5-61) then becomes 
yO) = yO) = 0, 


and, as we have seen, has yo(f) as its solution. 
The foregoing discussion can easily be generalized to initial-value problems 
of the form 
Ly = 6(t — a); 


yO) = YO) = --- = y*"%O) = 0, 


where L = D” + a,_,D"~' +--+ + ao. To solve this problem we again use 
Laplace transforms, first replacing δ( — a) by the function ἡ defined in (5-59), 
and then passing to the limit as 7 — 0. Thus 


(5-63) 


80} = 55 otf 


with p(s) = s” ας. 15 1 + +--+ + ao, and hence 


a -- 
κὸν Ε ak a 
[ " o(t — h(E) ἀξ, 


where g(t) = £"[1/p(s)]. Using the given value of A(t) we thus obtain 


0, t<a, 


t 
y(t) = a gt — di a<t<a+try, (5-64) 


1 a-+T 
oF g(t — ξ) dé, a+T <1, 


τ 
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and it follows that the solution of (5-63) is 


0, 1 <4, 
ge(t—a) t>a. 


yo(t) = (5-65) 


This result is valuable because it can be used to define the Laplace transform of 
5(t — a). Indeed, by Formula (5-26) we have 


L[yo] = e “L[g] 
—<as l 


p(s) 


On the other hand, if we apply ὦ to (5-63), under the unjustified assumption 
that £[6(t — a)] exists, we find that 


— € 


Ϊ 
ἂν = -α- £L[d(t — α)Ἱ]. 
Thus if £[6(¢ — a)] exists at all it must have the value e~**, and hence we are 
forced to the definition 
L£[6t — a] =e ™. (5-66) 


(For a different approach to this formula see Exercise 1 below.) In particular, 
for a = Ο we have the curious formula 


£[a()] = 1. (5-67) 


This apparent contradiction of Theorem 5-3, which asserts that £[f]— Ὁ as 
5 —> oo, is merely a reflection of the fact that δ() does not belong to the space of 
piecewise continuous functions of exponential order. But this is hardly surprising 
since, as was pointed out above, 6(f) is not even a function in the usual sense of 
the term. 


EXAMPLE. Consider a spring in equilibrium with a body of mass m attached. 
Suppose that at time ¢ = Ο the system is subjected to a sinusoidal force h(t) = 
A sin wt, and that at time ¢ = 10 it is struck a sharp blow from below which in- 
stantaneously imparts 2 units of momentum to the mass. Problem: Find the 
motion of the system from ¢ = Ὁ onward. 

In this case we have to solve the initial-value problem 


d*y 


me ἢ ky = Asinwt — 2 dt ἘΞ 10), 


)7(0) = ν'(0) = 0. 
Then 


A —108 
(ms? + kK)£Ly] = ae — 2e ὡ ; 


and 
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ΝΕ Aw τι: 2 --108 
SUI ΤΩΣ kyo? + a8) mst FRO 


Referring to our earlier calculations, the inverse transform d(t) of 
Aw/[(ms? + k)(s? + w?)] is given by either (5-57) or (5-58) depending on 
whether ὦ ~ ./k/m or not. As for the second term, its inverse transform is 


0, ¢ < 10, 
e(t) = 2 
- sin ν Κύήμι (1 — 10), t¢ > 10, 
Vkm 
2 


= - ee Ujo(t) sin V k/m (t = 10). 
m 


Hence y(t) = d(t) + e(t), and the description of the motion is complete. 


EXERCISES 


1. 


Show that the definition 
L[6(¢ — a)] = ΠῚ ΦΙλ()], 


where μ( is defined by (5—59), leads to the same result as Formula (5--66). 


. Let y(t) be defined as in (5-64). Prove that 
lim y(t) = ° ΓΞ α, 
70 g(t —a), t>a. 


Use this result to verify that (5—61) is correct. 


. Solve the initial value problem 


y"+y=e+ OC — 1); 
y¥=1, γ00) ΞΙΊ, γ0) =2. 


. Find the equation of motion of a weight having mass m which is initially in equilib- 


rium at the end of a spring, and which, at time ¢ = 0, is struck a sharp blow from 
above which instantaneously imparts 1 unit of momentum to the system. 


. A weight of mass 1 is attached to a spring whose spring constant is 4, and at time 


t = 0 the weight is struck a blow from above which instantaneously imparts 1 unit 
of momentum to the system. At time ¢ = 7/2 a sinusoidal force of magnitude 
—sin (¢ — (a/2)) begins to act vertically on the system. Find the equation of motion 
of the mass. 


. A mass m, hanging in equilibrium at the end of a spring, is struck from below and 


instantaneously given two units of momentum. At time ¢ = a the mass is subjected 
to the external force sin (¢ — a). Assuming that the spring constant is different 
from m, find the equation of motion of the mass m. 
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7, 


10. 


11. 


12. 


A unit mass is attached to a rigid spring whose spring constant is 3, and is then 
mounted in an elevator as shown in Fig. 5-17. At time ¢ = 0 the elevator begins 
to descend with a constant velocity of 2 ft/sec, and at that moment the mass is struck 
a blow from above which instantaneously gives it one unit of momentum. Find the 
equation of motion of the mass as a function of time. 


- 


FIGURE 5-18 


FIGURE 5-17 


. Amass m is suspended on a spring beneath a car which moves with constant velocity v 


along the track shown in Fig. 5-18. Suppose that at time 1 = Ὁ the mass is struck 
from below and instantaneously given one additional unit of momentum. Find the 
equation for the motion of m in the vertical direction as a function of time. 


. Find the equation of motion of a mass m bobbing at the end of a spring with spring 


constant k if the mass was originally displaced a units from equilibrium and given 
initial velocity b. (This is an example of what is known as simple harmonic motion.) 
It is observed that the spring of Exercise 9 oscillates with a period of 2 seconds when 
mis 1 gram. 
(a) Determine the spring constant k. 
(b) Now suppose the mass on this spring is 9 grams and that the oscillations start 
at a = 4 with initial velocity ὁ = +. Find the period and amplitude of the 
oscillations. 
Suppose that a spring is suspended in a resisting medium which opposes any motion 
through it with a force proportional to the velocity of the moving object. 
(a) Show that the equation governing the motion of a mass m bobbing at the end 
of such a spring is 

my” + dy’ + ky = 0, 


where Δ is a positive constant and k is the spring constant. 
(Ὁ) Let y(0) = a, y’(0) = ὁ for the mass in (a). Show that 


_ el ΕΞ + »ὸ -Ἐ Ma 
ave ms2 + As +k 


Assume that the resisting force in Exercise 11 is sufficiently large to ensure that 
2 > 4km. 


13. 


14. 


15. 


16. 


17. 
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(a) Show that the quadratic equation ms? + ἃς + k = 0 then has distinct negative 
roots, —71, -- σὴ witha; < a2, and that 


y=e Ta + Be 2-74, 


where 
panes 2bm + ar Ge 2bm + ar 
2 2/2 — 4km 2 2/2 — 4km 
Β λ-- ν λΖ -- 4km " A+ νλ2 -- 4km 
| i ey et = Ὁ ἸΞΞΟΛ ΞΘ ΈΞΞΞΞΕΙ  ΣΣΞΞ  -ΞΞΞΞΞΟΣ ΟΣ ΞΞΣΞ ΩΣ ΞΕ 


2m 2m 


(b) Show that except in the trivial case where y = 0, the mass in this problem is in 
its equilibrium position y = 0 for at most one value of ¢. (The effect of the resistance 
in this problem is often described by the word “‘damping,” and the resulting motion 
is known as damped harmonic motion.) 


Suppose that the spring in Exercises 11 and 12 has spring constant 9, and that a unit 
mass is attached to the spring, displaced one unit in the positive y-direction, and given 
an initial velocity b = —10. Suppose in addition that the medium offers a resistance 
corresponding to \ = 10. 

(a) Find the equation of motion of the mass. 

(b) Show that the mass is in its equilibrium position for exactly one instant. When 
is this? 

(c) What is the maximum height which the mass attains? (Recall that the positive 
y-direction is downward.) 

(d) Sketch the graph of the solution curve for this problem. 

Show that a necessary and sufficient condition that the mass of Exercises 11 and 12 
be in its equilibrium position at some one instant after the motion begins is that 
0 < —a/® < 1, and hence deduce that if a # 0 and ὁ = 0 the mass approaches 
its equilibrium position without ever passing through it. 

Show that the quadratic equation ms? + ἃς + k = 0 for the vibrating spring prob- 
lem described in Exercise 11 has a double root s = —o = —d/(2m) < 0 when 
\? = 4km. Find the equation of motion of the mass in this case. (This is an ex- 
ample of what is known as critical damping.) 

Let y = y(t) be the solution obtained in Exercise 15. 

(a) Show that y — 0 as t — οὔ, and that the mass passes through its equilibrium 
position at most once during the motion. 

(Ὁ) Show that if δα < —o, then y = 0 when t = —a/(ao + δὴ) > 0, but that 
otherwise the mass approaches its equilibrium position without ever passing through 
it. (Assume y # 0.) 

Find the equation of motion for the system in Exercise 11 in the case where \? < 4km. 
What is the behavior of y as t — «? 


Ι 
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A SHORT TABLE OF LAPLACE TRANSFORMST 


Function Transform 


fo Lf] = [ e*' f(t) dt 
a f(t) + Belt) oS[f] + BEES] 
fo s£Lf] -- fO*) 
ft) τ — Σ ΚΟ) -- f'0*) 
s"Sif] — ἀν δεν, 
ἐὰ f" 07 


1 
: Lf] 


tee 
5 0 Ja 
n times ᾿ ᾿ ͵ 
ΝΠ Κὸ αἱ... ἀἱ 
ἐῶν δ τε θ 


n—1 times 


e”* f(t) f(s — a), where =A Lf] 
t” f(t) (- 1) ἡ ΓΑ, 


Ua(t)g(t) = ΠΣ aie e Liat + ad] 


g(t), t>a 


+ The table consists of three parts. The first contains formulas of a general nature, 
and the second the transforms of a small number of selected functions. When used in 
conjunction, these two parts of the table will yield the Laplace transforms of most func- 
tions which occur in practice. The third part of the table is primarily intended for com- 
puting inverse transforms, and hence is designed to be read from right to left. The methods 
of partial fractions, completing the square, etc., are, of course, indispensible in such 
computations. Finally, those formulas in the first part of the table which are particularly 
well suited to evaluating inverse transforms have been marked with an asterisk. 


TABLE OF LAPLACE TRANSFORMS. 


A SHORT TABLE OF LAPLACE TRANSFORMS (Continued) 


Function Transform 


* Ψ}" 0, —as 
Ug(t)g(t — a) = ᾿ ae e L£[g] 


᾿ Κι — ξ)φ(ἢ) at ΠΡ] 


f(t) periodic with period p (p > 0) 


fe f(t) at 


1 — e ?8 


LO if lim TED gi | L&E f] ds 
t t Ot t δ 


sin at 
COS at 
sinh at 


cosh at 


6(t) 
6(t — a) 


n—l1 at 
e 


t 

(1 — ἢ! (s— ay” 
—= (sin at — atcosat) weal 
2a (52 + q2)2 
t, educa 


t 
ΐ -ἴ 1 1 
I on τ Ἴ πρὶ a 


(s?  α2}»11 


=| 1 5 
an - ἐκ πρὶ 


(52 + q@2)rtl 
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A SHORT TABLE OF LAPLACE TRANSFORMS (Continued) 


Function Transform 


t t t 
1 ᾿ 1 
enemies: t ΐ eo ee oe © t ce 
aan! [ ἢ i tsinatdt:::d G2 qari 
V——_ ~~  -- -οο»ο, - 


n times 


t t έ 
: [{. [τ tdt +> dt : 
ee es eee 1 a eee eee 
2"an! Jo Jo 0 (s2 + g@2)rtl 


"»“----΄--,-νοτ-- “. 
n—1 times 


6 
further topics in the theory of 


linear differential equations* 


6-1 THE SEPARATION AND COMPARISON THEOREMS 


In this chapter we resume the general discussion of linear differential equations 
begun in Chapter 3, and establish a number of extremely valuable results concern- 
ing equations with variable coefficients. The first two are almost immediate con- 
sequences of Abel’s formula (Theorem 3-7), and describe the behavior of the 
zeros of solutions of second-order homogeneous linear differential equations. 


Theorem 6-1. (Sturm separation theorem.) Jf y; and ye are linearly in- 
dependent solutions of the second-order homogeneous equation 


a2(x)y"" + ay(x)y’ + ao(x)y = 0 (6-1) 


on an interval I in which az does not vanish, then the zeros of γι and y2 
alternate on 1.7 


Proof. Let a and b (a « δ) be two points of 7 such that yo(a) = γο(δ) = 0, and 
suppose that γὼ. is nonzero everywhere between a and ὁ. We must show that there 
exists exactly one point c between a and ᾧ such that y,(c) = 0. (See Fig. 6-1.) 


yy, (x) 


FIGURE 6-1 


* None of the material in this chapter will be used in any essential way until Chapter 15 
where equations with regular singular points are studied. 

ΤΑ zero of a function y is a point xo at which y(xo) = 0. It may happen, of course, 
that y; and y2 have no zeros on J, in which case the conclusion of the theorem is vacuously 
satisfied. 
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Since y, and yp» are linearly independent solutions of (6-1), their Wronskian 
never vanishes on 7 (Theorem 3-6). Hence the constant in Abel’s formula is 
nonzero, and 


W[yi(x), yo(x)] = yilx)ye(x) — γε(χ)νι(Χ) 


has the same algebraic sign everywhere in J. Moreover, the values of the 
Wronskian at x = a and x = bare, respectively, 


yila)jyh(a) and γι(δ)νδ(), 


and hence y;(a), y1(b), yo(a), and y(b) are all different from zero. But since a 
and b are successive zeros of yo, the derivative of γὼ must have opposite signs at a 
and ὁ (i.e., the graph of yo must be rising at a and falling at ὃ, or vice versa). 
Hence y,(a) and y,(b) have opposite signs, and it follows that y,(c) = 0 for at 
least one point c between a and ὁ. ἢ 

Finally, by reversing the roles of y,; and y2 in the above argument, we conclude 
that γὼ has at least one zero between every pair of successive zeros of γι on J, 
and we are done. ἢ 


EXAMPLE 1. On the strength of this theorem we can deduce the well-known 
fact that the zeros of sin x and cos x alternate on (— οὐ, 99), since these functions 
are linearly independent solutions of the equation 


y’+y =. (6-2) 
A somewhat less obvious consequence is that any two functions of the form 
a, sin x + a2gCos x, b, sinx + bgcosx 
have alternating zeros whenever αι γέ a2b,, for all such pairs of functions are 


also linearly independent solutions of (6-2). (See Exercise 1.) 


EXAMPLE 2. The functions sinh x and cosh x are linearly independent solutions 
of γ’ — y = O, and hence their zeros alternate on (— ©, «). This, of course, is 
obvious since sinh x has but a single zero, namely, x = 0, while cosh x has no 
zeros at all, and is cited merely to emphasize that the separation theorem says 
nothing at all about the number of zeros of a solution of (6-1). 


Questions of the latter sort can sometimes be answered by using the following 
theorem, also due to Sturm. 


Theorem 6-2. (Sturm comparison theorem.) Let γι and yg be, respectively, 
nontrivial solutions of the differential equations 


y’+piidy =0 and y’ + poly = 0 


* The validity of this assertion depends upon the fact that a continuous function 
assumes ail values between its maximum and minimum on a closed interval [a, δ]. 
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on an interval I, and suppose that p,(x) = Po2(x) everywhere in I. Then 
between any two zeros of γὼ there is at least one zero of γι, unless p,(x) = 
P2(x) and γι and yz are linearly dependent in C(J). 


Proof. Let aand ὃ be adjacent zeros of yo, with a < ὃ, and suppose that y, does 
not vanish in the interval (a, b).* Since the zeros of a function y are the same 
as those of —y, we may assume that y,; and yo are both positive throughout 
(a, b). Then, arguing as in the preceding proof, we have 


W(a) = yil(a)y2(a) = 0, 
W(b) = yr(b)y2(b) < 9, 


where W(a) and W(b) denote the values of the Wronskian of y; and y2 at aand Bb, 
respectively. But 


(6-3) 


2 Ws. VO] = ZprCovs) — yO 
= yi y¥(x) — yaw") 
= —yi(x)po(x)yo(x) + yo(x)pi)yi%) 
= yilx)yo(x)[pix) — pa(x)] 2 9, 


and it follows that the Wronskian of y, and yo is a nondecreasing function on 1... 
This, however, contradicts (6-3) unless p,(x) = p2(x), in which case W[y,(x), 
yo(x)] = 0 for all x in 1 Thus γι must have a zero between a and b whenever 
P1(x) # po(x). Moreover, the separation theorem implies that this result con- 
tinues to hold when p,(x) = po2(x) unless y, and ys are linearly dependent in 
C(J), and the proof is complete. J 


EXAMPLE 3. Every nontrivial solution of the equation 
γ' + pQx)yy = 0 (6-4) 


has at most one zero on any interval in which p(x) < 0. For if we apply the 
comparison theorem to this equation and 


» = 0, (6-5) 


we conclude that on such an interval every solution of (6-5) must vanish at least 
once between successive zeros of a solution of (6-4). The assertion now follows 
from the fact that γ΄ = Ο has solutions (namely y = c) which do not vanish on 
any interval. 


* At this point we are making use of the fact that a nontrivial solution of a second- 
order linear differential equation cannot have infinitely many zeros in any finite closed 
interval of the x-axis. (See Exercise 6.) 
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If we agree to say that a nontrivial solution of a linear differential equation 
oscillates on an interval Jif and only if it has at least two zeros in J, we can restate 
the conclusion of this example by saying that no solution of (6—4) oscillates on 
any interval in which p(x) < 0. In particular, this result holds for the nontrivial 
solutions of 

y”’ = ky =—_ 0 


on (— οὐ, o) whenever k is a positive constant (cf. Example 2). 


EXERCISES 


1. Show that the functions a1 sin x + az2cos x and b; sin x + becos x are linearly 
independent solutions of y’’ + y = Ὁ whenever ἀῶ τέ a2b, and thus prove that 
the zeros of these functions alternate on (— ©, οὐ). | 

2. Prove that sin k;x has at least one zero between any two zeros of sin k2x whenever 
ki > ko> 0. 

3. (a) Show that every nontrivial solution of the equation γ᾽" + (sinh χὴν = 0 has at 
most one zero in (— ©, 0), and infinitely many zeros in (0, 0). 

(b) Prove that the distance between successive zeros of any nontrivial solution of this 
equation tends to zero asx — ©. 

4. Every solution of the equation γ᾽ + xy = 0 has infinitely many zeros in (0, ©). 
True or false? Why? 

5. (a) Let f be continuous on (0, ©), and suppose that f(x) > e > 0 for all x > 0. 
Prove that every solution of γ΄ + f(x)y = 0 has infinitely many zeros in (0, ©). 
(Ὁ) Does the conclusion in (a) remain true if f(x) > 0 in (0, ©)? Why? 

*6. Prove that no nontrivial solution y(x) of a normal second-order linear differential 
equation can have infinitely many zeros in a closed interval J = [a, δ]. [Hint: Assume 
the contrary, and then show by partitioning 7 into arbitrarily small subintervals that 
there would exist a point xo in J with the property that every open interval centered at 
I contains infinitely many zeros of y(x). Use this fact to prove that 


y(xo) = (xo) = 9, 


and then invoke the uniqueness theorem. ] 


6-2 THE ZEROS OF SOLUTIONS OF BESSEL’S EQUATION 


The second-order linear differential equation 
x?yl" + xy’ + αὖ — p*)y = 0, (6-6) 


p a non-negative real number, is known as Bessel’s equation of order p. It is easily 
one of the most important differential equations in mathematical physics, and will 
be studied in some detail in Chapter 15. For the present we restrict ourselves to 
investigating the behavior of the zeros of its solutions on the interval (0, oo). 
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Before the comparison theorem can be applied to (6-6) the term involving γ' 
must be eliminated. This can be done by making the change of variable y = u/./x 
which transforms (6-6) into 


_ τα ὦ 
μ Ὁ (1 + 1) iO (6-7) 


without disturbing the zeros of its solutions. Thus it suffices to study the solutions 
of (6-7). There are three cases to be considered. 


Case 1. O<p< i. Then 1 + (1 — 4p?)/4x? > 1, and the comparison 
theorem implies that every solution of Bessel’s equation vanishes at least once 
between any two zeros of a nontrivial solution of u’’ + u = 0. But, as we know, 
the general solution of this equation is c, sin x + c,cos x. Moreover, if a is an 
arbitrary real number, c,; and cz can be chosen in such a way that the zeros of 
c, sin x + cocosx area,a + T,a + 2n,... (See Exercise 2.) Thus we conclude 
that every solution of Bessel’s equation of order p, p < %, has at least one zero in every 
subinterval of the positive x-axis of length πὶ 1.6., the distance between successive 
zeros of these solutions does not exceed 7. Finally, it is not difficult to show that 
this distance is always less than a, and approaches π as x — οὐ (Exercise 3). 


Case 2. p = 4. Here Eq. (6-7) reduces to u’’ + u = 0, and the general solution 
of (6-6) can be written explicitly as 


y= Ene: sin x + C2 COs x). 


Vx 


The remark made a moment ago concerning the choice of c, and 6. again applies, 
and we can assert that the zeros of every nontrivial solution of Bessel’s equation of 
order ὁ are equally spaced along the positive x-axis, successive zeros separated by 
an interval of length zx. 


Case 3. p> 4. In this case 1 + (1 — 4p”)/4x? < 1, and comparison with 
u’’ + u = 0 implies that every nontrivial solution of (6—7) has at most one zero 
in any subinterval of the positive x-axis of length 7. To prove the existence of 
zeros here we reason as follows. 

For any fixed value of p, (1 — 4p”)/4x? — 0, as x — ow. Hence there exists 
an Xo > O such that 1 + (1 — 4p”)/4x? > 4 whenever x > xo, and we now 
apply the comparison theorem on the interval (x9, 00) to (6-7) and the equation 
u’’ + 4u = Owith general solution c, sin \/2/2)x + c2 cos (\/2/2)x. Since this 
last function has infinitely many zeros in (xo, οὐ) with successive zeros separated 
by an interval of length ./2 x, it follows that every solution of Bessel’s equation of 
order p ἢ has infinitely many zeros, and that the distance between successive 
zeros eventually becomes less than 1/2. By modifying the argument in the 
obvious way, it can be shown that here too the distance between successive zeros 
approaches 7 as xX — oo. 
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EXERCISES 


1. Verify that the substitution y = u/+/x reduces Bessel’s equation of order p to 


1 — 4p” 
ul + (: +). = 0. 

2. Prove that for any real number a there exist constants c; and c2 such that the zeros of 
cysinx + cocosx area,a +m7,a + 27,.... 

3. (a) Prove that the distance between successive zeros of any nontrivial solution of 
Bessel’s equation of order p < ξ is always less than π. [Hint: For any fixed p < 3, 
and any x9 > 0,1 <1 +« < 1+ (1 — 4p?)/(4x?) on (0, xo).] 

(b) Prove that the distance in (a) approaches 7 as x — ©. [Hint: (1 — 4p?)/(4x?) 
—OQasx— o.] 

4. Prove that the distance between successive zeros of any nontrivial solution of Bessel’s 
equation of order p > 4 approaches 7 as x — ©. 

*5. (a) Let ao(x) be continuous on (0, ©), and suppose that there exist positive numbers 
b, Bsuch that b? < ao(x) < B*forallx > 0. Prove that every nontrivial solution of 


y” + ao(x)y = 0 


has infinitely many zeros on (0, ©), and that the distance d between successive zeros 
can be estimated as 

τ π 

—<d<-: 

Β΄ τὸ 
[Hint: Use the comparison theorem on the given equation and each of γ΄ + δὲν = 0 
and γ΄ + By = 0.] 
(b) Use the results in (a) to deduce the facts proved in this section concerning the | 
zeros of the solutions of Bessel’s equation. 


6. Let 
2 


d 
arte) ΤΣ + a(x) 2 + aoidy = 0 


be normal on an interval 7. Show that there exists a function v(x) defined on J with 
the property that the substitution y = uv reduces this equation to 


μ᾽ + i(xju = 0. 


(The function i(x) is called the invariant of the equation.) 

7. Use the method suggested in Exercise 6 to reduce the following equations to a form in 
which the first derivative does not appear. (In each of these equations p is a non- 
negative constant.) 

(a) x?y"’ + xy’ + (x? — p*)y = 0 

(Ὁ) (1 — x?)y’” — 2xy’ + p(p + Dy = 0 

(c) (1 — x?)y” — xy’ + p*y = 0 (d) »" — 2xy’ + 2py = 0 
8. Prove that every nontrivial solution of the Hermite equation 


γ᾽" — 2χγ' + 2py = 0, 


p ἃ non-negative constant, has at most finitely many zeros on (— ©, ©). [Hint: See 
Example 3 and Exercise 6 of the preceding section, and Exercise 7 (d) above.] 
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6-3 SELF-ADJOINT FORM; THE SONIN-POLYA THEOREM 
Let 


a(x) 4 f+ a(x) ® + agxy = 0 (6-8) 
be normal on an interval J, and let 


p(x) a οἱ (a1(2)/a2(z)] dx (6-9) 


d d ὦ 
£ (re #) - px) 22 at +o p(x) => 


Eq. (6-8) may be rewritten 


£ (ρου 2) + 22 poay = 0, 


Then since 


or, more simply, 


4 (ve 2) + acay = 0, (6-10) 


where q(x) = [ao(x)/ao(x)]p(>). 

Equation (6-10) is known as the self-adjoint form of (6-8), and enjoys certain 
advantages over the original version of the equation. Not the least of these is 
that it provides a “standard form” for all normal second-order linear differential 
equations which is easy to derive, and, as we shall see, well suited for computa- 
tions. For future reference we note that the function p(x) appearing in (6-- 10) is 
always positive throughout the interval 7. 

In addition to the self-adjoint form, there are a number of other special forms 
for normal second-order equations which are sometimes useful. One of them 
involving the invariant of the equation was given in the exercises at the end of 
the last section. Another is a normalized version of the self-adjoint form in which 
p(x) = 1. It can be deduced from (6-10) by making the change of variable 


ax 
p(x) 


dy _ dy dt Ι dy | 


For then 


dx dt dx p(x) dt 
d dy d {dy d {ἀνὰ dt 1 d’y 
di (oc) #) dx (2) - di (2) 4 dx ~ plx) dt’ 
and (6-10) becomes 
ΤΣ. Oy = 0, (6-11) 
where Q(t) = p(x)q(x). 
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This argument proves that every normal homogeneous second-order linear 
differential equation can be written in the form required by the comparison 
theorem, and thus considerably extends the usefulness of that result. Actually, it 
proves even more. For if the points x9 and fg correspond under the change of 


variable 
ie | dx 
p(x) 


introduced in passing from (6—10) to (6-11), and if 


Oi(t) = p(x)qi), 
O2(t) = (Δ) 20). 


then the fact that p(x) is positive throughout J implies that Q1(t9) > Qo(to) if 
and only if φιίχο) > go(xo). Thus if 


4 4 
ΠΣ τ Oly πὸ and 24 Ομγ(ὴν = 0 


are deduced, respectively, from the self-adjoint equations 


τ (pe) 4) + φιί(χ)ν = 90 and £ (pe) 9) + 42(Χ)ν = 0, (6-12) 


then Q,(t) > Q(t) if and only if g(x) > g2(x). Hence the comparison theorem 
stated in Section 6-1 is also valid for a pair of self-adjoint equations of the form 
(6-12) whenever gi(x) > q2(x) on 1.* 

As a final application of the ideas we have been exploring here we prove a rather 
surprising result concerning the zeros of the derivative of any solution of a certain 
class of self-adjoint equations. 


Theorem 6-3. (Sonin-Polya theorem.) Let p(x) > O and q(x) ¥ 0 be 
continuously differentiable on an interval I, and suppose that p(x)q(x) is 
nonincreasing (nondecreasing) on I. Then the absolute values of the relative 


* The reader should note that we have proved this assertion under the assumption 
that the function p(x) is the same in both equations in (6-12). It can be shown, however, 
that the conclusion of the comparison theorem continues to hold exactly as stated earlier 
for the solutions of a pair of self-adjoint equations 


dx 


in which qi(x) > φο(χ) and 0 < pi(x) < pe(x). For a proof of this more general 
theorem see G. Birkhoff and G. C. Rota, Ordinary Differential Equations, Ginn, Boston, 
1962. 


2 (m9 #) + qi(x)y = 0, 4 (νὼ #) + q2o(x)y = 0, 
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maxima and minima of every nontrivial solution of the equation 
d d 
4 (ne Φ) + ae = 0 (6-13) 


are nondecreasing (nonincreasing) as x increases.* 


Proof. Let y be a nontrivial solution of (6-13), and consider the function 


F(x) = D@)P + are πὸ ρα)» ΟἽ. 
Then 
Ρ' = 2γγ' + “PY (pyry — PD (py? 
| Pq (pq)? 
and since, by assumption, (py’’ = —qy, 


2 
F(x) = — (x) ᾿ς (pq). 


Now suppose that pg is nonincreasing on J. Then d/dx(pq) < 0 and F is non- 
decreasing on 7 (i.e., F’ > 0 on J). Hence the same is true of any sequence of 
values of F computed at points x; < x2 «τ᾿. If, in particular, x1, x2,...are 
the points at which y has a relative maximum or minimum, then y’(x;) = 
F(x,;) = y(x;)”, and we have 


lA 


y(x3)? < y(x2)? 
Thus 
yap < [γ 2)] Ss, 


as asserted. A similar argument applies when pq is nondecreasing, and the proof 
is complete. J 


EXAMPLE. In the preceding section we proved that every nontrivial solution of 


Bessel’s equation of order p has infinitely many relative maxima and minima on 
(0, 0). Since the self-adjoint form of Bessel’s equation is 


d 2 2 
UQ+(Cstp-. ow 


and since p(x)q(x) = x? — p?” is increasing and positive on the interval (p, 0), 
the Sonin-Polya theorem implies that the magnitude of the oscillations of such a 


* Note that the relative maxima and minima of a solution y of (6-13) are the zeros of y’. 
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7 FIGURE 6~2 


solution is nonincreasing on this interval. In fact, in this case it can be proved 
(see Exercise 6) that the oscillations actually decrease as shown in Fig. 6-2 where 
the graph of a solution of Bessel’s equation of order 1 has been sketched. 


EXERCISES 

1. Write each of the following equations in self-adjoint form. 
(a) (1 — x*)y"’ — 2xy’ + by = 0 (b) x*y” — 2x8y’ — (4 — x?)y = 0 
(c) (x? — 2)»" — x?y’ — 3y = 0 (4) 2x(In χ)ν"" + 3y’ — (sinx)y = 0 


(e) & + Dy” — y’ + 2xy = 0 


. Prove that if γι and y2 are solutions of the self-adjoint equation 


d dy ᾿ 
ae (rc #) + q(x)y = 0, 


then p[y1y2 — yiy2] is a constant. (This result is known as Abel’s identity.) 


. Write Bessel’s equation in the form 


dy + Ο(ὃν = 0 
412 os 


by using the substitution suggested in the text. 


. (a) Prove that no solution of a self-adjoint equation 


d dy 

oe x) — x)y = 0 

4 ( ( BY κα yy 

can oscillate in any interval where g(x) < 0. 

(b) For each of the equations in Exercise 1 determine the intervals of the x-axis in 
which a nontrivial solution can have at most one zero. 
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5. Discuss the oscillatory behavior of the nontrivial solutions of each of the following 
equations. 


1 
(a) 2x*y” + 6xy’ + (: - 4) y = 0 


(b) y’ -- γ +e" — x)y = 0 (c) xy" + xy’ + οὗ — Dy = 0 
6. Prove that the sequence of absolute values obtained in the Sonin-Polya theorem is 
strictly increasing (decreasing) when pg is strictly increasing (decreasing). 
7. (a) Discuss the oscillatory behavior of the nontrivial solutions of Airy’s differential 
equation 
y’ +xy=0 
on (—, ©). 
(Ὁ) Prove that if y(x) is a solution of Bessel’s equation of order § on (0, ©), then 
x1/2y(2x3/2) is a solution of Airy’s equation. 
8. Let p(x) and q(x) > 0 satisfy the hypotheses of the Sonin-Polya theorem, and let y(x) 
be a nontrivial solution of the equation 


d dy 2 
Ζς (pe *) + 4(Χ)» = 0. 


Prove that the values of |p(x)q(x)|/2|(x)| at the points where y’ = 0 form an increas- 
ing (decreasing) sequence if p(x)q(x) is an increasing (decreasing) function. [ Hint: 
Argue as in the proof of Theorem 6-3, starting with the function 


F(x) = ρα μοῦνον) + [p@dy’CO}*.] 


6-4 POWER SERIES AND ANALYTIC FUNCTIONS 


In an earlier section we introduced the equation x2y” + xy’ + (x? — p®)y = 0 
to illustrate how the comparison theorem is used to obtain information about 
the solutions of a differential equation. This particular equation is but one of a 
number of linear differential equations with variable coefficients which arise re- 
peatedly in mathematics and mathematical physics, and whose study has had a 
decisive influence on the development of the theory of differential equations. 
One of the distinctive features of these equations is that their solutions cannot, 
in general, be expressed in closed form in terms of elementary functions. Thus it iS 
quite impossible to “solve” them within the context of the naive interpretation 
which considers a solution of a differential equation as a neat little formula in- 
volving familiar functions. Nevertheless, it is possible to gain information about 
the solutions of such equations (witness our discussion of the oscillatory behavior 
of the solutions of Bessel’s equation) and, in fact, enough information to be able 
to use these solutions effectively in the analysis of other problems. This suggests 
that we ought to drop the artificial restriction of seeking solutions within some 
preassigned collection of “known” functions, and adopt instead the larger point 
of view which sees the solutions of a differential equation as functions defined by 
the equation itself. 
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One example of the way in which this point of view can be exploited was given 
earlier when we derived all of the familiar properties of the functions sin x and 
cos x from the fact that they satisfy the equation γ΄ + y = 0 (see Section 3-8). 
Another is furnished by that treatment of the natural logarithm which sees this 
function as the solution of the first-order equation xy’ = 1 subject to the initial 
condition y(1) = 0. Together these examples pointedly illustrate the fact that 
one of the most satisfactory ways of defining new functions in mathematics is as 
solutions of differential equations. 

In the remaining sections of this chapter we shall use the method of power 
series expansions to study the solutions of a certain large class of linear differential 
equations, or, rather, to study the functions defined by this class of equations. 
Since this discussion depends upon certain results in the theory of power series 
expansions of analytic functions we begin by reviewing some of the basic facts 
concerning such series. It is assumed that the reader is already familiar with these 
results, and the real purpose of this resumé is to fix terminology and provide 
formulas for convenient reference. 

In the first place, we recall that an expression of the form 


οο 


δ a(x δὶ Xo)", (6-15) 


k=0 


Xo and a; constants, is called a power series in x — Xo, or, alternately, a power 
series about the point xo, and is said to converge at x, if and only if the series 
obtained from it by setting x = x, is a convergent series of real numbers. It is 
well known that every power series about x9 either converges at the single point 
x = Xo, or else throughout an interval centered at xo of the form |x — xo] « r 
withO <r < o. If, in the latter case, r is chosen as large as possible, the series 
diverges when |x — xo] > 7, and for this reason r is called the radius of con- 
vergence of the series.* 

Every power series with radius of convergence r defines a function f in the 
interval |x — χροὶ < r, and we write 


i?) 


f(x) = » a(x — Xo)’. (6-16) 


k=0 


It can be shown that such functions are infinitely differentiable throughout 
|x — Xo| <r, and that 


ΡΟ = Σ᾽ καμὰ — x0) 
k=1 


Χο) = 3 k(k — lax — xo)", (6-17) 
k=2 


* The behavior of a power series at the endpoints of its interval of convergence cannot 
be predicted in advance. 
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where the radius of convergence of each of these derived series is identical with 
the radius of convergence of (6-16). In short, a power series may be differentiated 
term-by-term without changing its radius of convergence. 

Any function which can be represented by a convergent power series of the 
form (6-16) in an open interval J about the point xo is said to be analytic at Xo. 
We have just seen that such a function must have derivatives of all orders every- 
where in J, and, as might be expected, is actually analytic at each point of 1. Thus 
it is customary to speak of functions as being analytic on an interval, and the 
phrase “analytic at x9” is used primarily to direct attention to the point about 
which the series is expanded. Finally, the reader should be aware of the fact that 
all of the elementary functions in mathematics—polynomials, exponentials, 
trigonometric functions, etc.—are analytic. Indeed, this is one of the major 
results of that chapter of calculus which deals with Taylor series expansions of 
(analytic) functions, and will be used throughout the following discussion. 


EXERCISES 


1. Let @(J) denote the set of all functions analytic on an open interval J of the x-axis. 
Prove that @(J) is a real vector space under the “usual” definitions of addition and 
scalar multiplication. 


2. Let y(x) be a solution of 


π᾿" 


Ta toe αορὺν = he) 


on an interval J, and suppose that ao(x), . . . ; @n—1(x), and A(x) are analytic at a point 
xo in I. Prove that y(x) is infinitely differentiable at xo. 


3. Prove that the power series expansion of an analytic function about the point xo is 
unique, i.e., that such a function has precisely one such expansion. 


“2 ΑΞ an—1 (x) 


6-5 ANALYTIC SOLUTIONS OF LINEAR DIFFERENTIAL EQUATIONS 


Analytic functions arise in the study of differential equations for the very simple 
reason that the solutions of any normal linear differential equation whose coef- 
ficients and right-hand side are analytic on an interval 7 are themselves analytic 
on J. This result is known as the existence theorem for equations with analytic 
coefficients, and in contrast to most existence theorems in the theory of dif- 
ferential equations immediately leads to an explicit technique for computing 
solutions. Before introducing this technique, however, we give a formal statement 
of the theorem in question. 


Theorem 6—4. (The existence theorem for equations with analytic coef- 
ficients.) Let 


FY aye) $+ + αρρὺν = he) ἀ(68) 
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be anormal nth-order linear differential equation whose coefficients ao(x), . . . , 
ἄμ. 1(Χ) and right-hand side h(x) are analytic in an open interval I. Let xo 
be an arbitrary point in I, and suppose that the power series expansions of 
Ao(x),..., h(x) all converge in the interval |x -- xo| <r, r > 0. Then 
every <olition of (6-18) which is defined at the point x is analytic at 
that point, and its power series expansion also converges in the interval 
Ix — χοί <r. 


It is important to note that this theorem not only asserts the analyticity of 
solutions of an equation of the type described, but also specifies an interval in 
which the power series expansions of these solutions converge. At the same time, 
it should be observed that we make no statement concerning the behavior of such 
Series outside this interval. As we shall see, this is in the nature of things, since 
it is possible to give examples of series solutions which converge in a larger in- 
terval than the one described above.* 


EXAMPLE 1. Find the general solution of 


y+ xy +y=0 (6-19) 
on (— 0, οὐ). 

Since this equation satisfies the hypotheses of Theorem 6-4 on the entire x-axis, 
each of its solutions has a power series expansion about the point x» = O which 
converges for all values of x.t To compute these solutions we use the so-called 
method of undetermined coefficients, as follows. 

Let y(x) be an arbitrary solution of (6-19). Then for suitable constants a, we 
have 


γα) = Σ) ax", (6-20) 
k=—0 
and 


y(x) = > ka,x*—', = y"(x) = SS k(k — 1)a,x"-?. 
ἐπι me 


Substituting these series in (6-19), we obtain 


ΌΟ 


Σ) κ(κ — 1)a,x"—? + 5 ka,x" + » a,x" = 0, (6-21) 


k=2 k=1 k=0 


and it follows that (6-20) will be a solution of the given equation if and only if 
the a, are chosen so that the sum of the coefficients of like powers of x in this 
expression are all zero (see Exercise 3 of the preceding section). 


* For a proof of Theorem 6-4 the reader should consult E. A. Coddington, An Intro- 
duction to Ordinary Differential Equations, Prentice-Hall, Englewood Cliffs, N. J., 1961. 

Τ The student should appreciate that the choice xo = 0 is one of convenience, not 
necessity. 
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To facilitate collecting terms in (6-21) we now replace the index of summation 
in the first series by kK + 2, which can certainly be done without prejudice to the 
sum of the series. This gives 


οΌ 


>> (kK + 20k + Vanyox" 


k+2—=2 


>> κ( — Wagx"~? 
k=2 


ST k + Wk + Dargo’, 


k=0 
and (6-21) becomes 


οο 


SK + 2K  ᾿λακοχῦ + YD kax® + D7 ax! = 0. 
k=0 


k=1 k=0 


But since the order of summation in a power series is a matter of indifference, we 
can rewrite this expression as 


ay + 265 + D> K+ INK + 2)ακ..5 + ayjx" = 0; 
k=1 
whence 
ag + 265 = 0, 


(k + 2)αι.5 + a = 0, ΚΣ 1. 


The second of these equations is known as a recurrence relation (or finite dif- 
ference equation), and can be used to express the a; from k = 3 onward in terms 
of the preceding ones. Moreover, since ag = —(@o/2), it follows that all of the 
ας fork > 2 are uniquely determined by the values of ay and αι. They fall into two 
distinct sets depending on the parity of k, as follows: 


k even k odd 
ao ao αι ay 
$2 = Ὁ 
Qa Qa 
a= 405 a5= 5.3 
os, junt ὁ M0 Ss fe, ee 
δ ee Oe Fes a3 


ao ai 


a as Re .. “0 —_ ὲὶ᾽᾿᾽ὁ . ae FO ee ee 
ax = (1) ὭΩΚ -- 2). 4-2 “πνεῖ = Se ORE DOR] 1) 5-3 
Substituting these values in (6-20), we obtain 
x? x4 x® 
w(x) = ao] Σ΄ δὰ 
χϑ x? x! | 
talx-5+35-7355+--} 10:2.) 


where do and a, are arbitrary constants. 
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To complete the problem it remains to show that (6-22) is the general solution 
of the given equation on (— οὐ, «). To this end we introduce the series 


x28 


yo(x) = 1 + Qu (-)" opaR οὐ 


ἜΣ (6-23) 
= ᾿ xt 
γι(Χ) = x + 2 (~1) Qk + D@k—1)---5°3° 
and rewrite (6-22) as 
V(X) = Aoyol(x) + αι» 10}. (6-24) 


An easy computation using the ratio test now shows that yo and y, both converge 
for all values of x. Hence so does (6-24), and we conclude that this expression is a 
solution of (6-19) on the entire x-axis, just as predicted by Theorem 6-4. Finally, 
we note that yo and γ1 are themselves solutions of (6-19), and that 


yo9) = 1, γρί(θ) = 0, 
yi0) = 0, = yi 0) = 1. 


Hence yo and y, are linearly independent in C(— «, «) and therefore span the 
solution space of (6-19) (cf. Theorem 3-3). This implies that (6-24) is the general 
solution of the given equation, and we are done. 


EXAMPLE 2. The differential equation 
( — x?)y” — 2xy’ +A + Dy = 0, (6-25) 


λ a non-negative constant, is known as Legendre’s equation of order \, and will 
play an important role in much of our later work. In this section we seek the 
power series expansion 


y(x) = > a,x" (6-26) 
k=—0 


of its general solution about the point x = 0. Before we begin, however, we note 
that since the leading coefficient of (6-25) vanishes when x = +1, Theorem 6—4 
only guarantees that the series in question will converge in the interval (—1, 1). 

This said, we substitute (6-26) and its first two derivatives in (6-25) to obtain’ 


io] 


(1 — x”) Σ᾽ Κά -- Wagx*~? — 2x Σ᾽) kagx** + ΧΟ + 1) DS ax* = 0, 
k=2 


k=1 k=0 
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Or 


Σ Κα — 1apx*-? — δ᾽ kk -- Layx* — Σ᾽ 2kazx" 
k=2 k=2 k=1 
+- >» AA + 1)a,x* = Ὁ; 


k=0 


By shifting the index of summation on the first series and consolidating the last 
three, this expression may be rewritten 


--αιχ + AMA + 76 + ayx] + 3 (kK + 2)(k + 1)az 42x" 
k=0 
ἘΣ τά = ἡ -- 2k 4904 Dix’ = 0. 627 


k=2 


Finally, we use the identity 
—kkK-1)-2kK+).A4+ )=A+k4+ Ια -- 
to put (6—27) in the simpler form 


2α5 + MA + ao + [A + 2A — Day + (8. 2ag)x 
+ DUK + 2K + Dare + AK + DA — Kajx* = 0. 


k=2 


To complete the solution we set the various coefficients in this last series equal 
to zero and solve the resulting equations. This gives 


262 + MA + Iago = 0, (A + 2) — Dai + (5: 2)ας = 0, 
(KK + 2) + Iaig2 + A+K+ DA -- Ka, = 0, k > 2, 


and it is now an easy matter to express all of the a; in terms of ag and a,. Indeed, 


GN, 
2 
a, — ~ ΑΕ 3Δ- 2). _ A+DAt DA — 2) 
oe το = el ee 
4-3 4! 
etc., while 


_Q+2DQA=), 


ag >= 31 19 
a. =< ~ Δ 4 -33; — AtHMAt DA -- YA -- 3) 
oA Oe A ee eS le 
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etc. In general, 


ax = (—1)" 
ye Ὁ 1 2k — τ) + 2k -- 3)+++ 0 Ὁ DAO = 2)++ 0 -- 2k + 2) 
(2k)! ἀν: 
(A - 21) + 2Κ -- 2)----Ο - 222 -- 1)---ἃΧΆ -Ἠ|2Κ-Ἠ [1 
ἀμ =  } ATMO F 2k - 9 τ AN a 


for all kK > 0, and it follows that (6-26) may be written 


W(X) = aoyo(x) + aiyila), (6-28) 
where 
yo(x) = 1 -- ATA 2 + Diss) se τ NN εὐνὰς ; 
(6-29) 
Ξε OF2O= Ds 4 Ὁ Ὁ HO + 20 — DA= 3) 6, 


and ay and a, are arbitrary constants. Moreover, since 


yi0)=090, yi) = I, 


we see that (6-28) is the general solution of Legendre’s equation of order ἃ on 
(—1, 1), as required. | 

When » is a (non-negative) integer the solutions of Legendre’s equation are of 
particular interest. For instance, when ἃ = 2n, n = 0,1,2,..., the series for 
Yo given above has only a finite number of nonzero terms, and hence is a poly- 
nomial. In fact, it is a polynomial of degree 2n involving only even powers of x. 
Similarly, when δὰ = 2n + 1, n = 0,1,2,...,91 is a polynomial of degree 
2n + 1 involving only odd powers of x. But since yo and γι are themselves solu- 
tions of (6-25) we conclude that Legendre’s equation has polynomial solutions for 
each non-negative integral value of the parameter Δ. These polynomials will be 
studied in considerable detail in Chapter 11, and we therefore say no more about 
them here other than to remark that they provide examples of power series solutions 
of a linear differential equation whose radius of convergence exceeds that predicted 
by Theorem 6—4.* 


* In fact, Legendre’s equation has polynomial solutions only when ἃ is a non-negative 
integer, and these polynomial solutions are the only ones which are continuous on the 
closed interval [—1,1]. For a proof see F. Tricomi, Differential Equations, Hafner, 
New York, 1961, p. 192. 
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EXERCISES 
Express the general solution of each of the following equations as a power series about the 
point x = 0. 

ly’+y=0 2. γ᾽ --γ-ΞΞ 0 

3. γ! — 3xy = 0 4. y’ -- 3xy’ —y =0 

5. (x2 + 1)y” — 6y = 0 6. (x2 + Dy” — 8xy’ + 15y = 0 

7. (2x2 + 1)»" + 2χγ' — 18y = 0 8. 2ν" + 2x2y’ — xy = 0 

9, γ" + x2y’ + 2xy = 0 10. γ΄ — x*y = 6x 

11. 3p” — xy + y = x27 + 2x41 12. γ"" + 3x2y” — 2y = 0 

13. γ"" — 3xy’ —y = 0 14. γ᾽" + x?y’ — xy = 0 


Use the method of undetermined coefficients to express the general solution of each of the 
following equations as a power series about the point x = 0, and specify an interval in 
which the solution is valid. 


15. 
16. 


17. 


18. 
19. 
20. 
21. 


22. 
23. 


24. 


(x” -- Ly” + xy’ -- 4y = 0 
(x7 — 2)y" 4+ x —y =x? 
25y 16 2x 
x2 — 4 χὰ -- 4 
οὖ -- 8)»" + x? + xy = 16 
αὖ + 2)»" + 6xy’ — 6xy = 0 
(x4 — 4)ν" — 36x"y! — 48xy = 0 
Use the method of undetermined coefficients to solve the initial-value problem 


" x , 
y Top a 


» + xy! — 2ν = e*; 
y(0) = γνῷ = 0. 


[ Hint: Expand e” as a power series about x = 0.] 
Find the general solution of Airy’s equation y” + xy = 0. 
Find a necessary and sufficient condition that a differential equation of the form 


(x? + ay” + Bxy’ + Vy = 0 


has a polynomial solution of degree n. 
Let yo and y, be the series solutions of Legendre’s equation given in (6-29). 
(a) Find the radius of convergence of these series. [Hint: Use the ratio test.] 


(0) Prove that up to constant multiples Legendre’s equation of order n (n a non- 
negative integer) has only one polynomial solution. 


(c) Prove that the function 


x 1+ x 
Fin(t tx) - 


is a solution of Legendre’s equation of order one on the interval (—1, 1), and use 
this fact to write the general solution of the equation in closed form. 
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25. The second-order linear differential equation 
γ' — 2χν' + 2dy = 0, 


λ a non-negative constant, is known as Hermite’s equation of order δ. 
ὸ ‘ . ‘ ς Ν, 2 : ᾧ 
(a) Prove that y is a solution of this equation if and only ifu = e—* /*y is ἃ solution 
of 
uw’ + (2A +1 — xu = 0. 


(b) Use the method of undetermined coefficients to find a basis for the solution space 
of Hermite’s equation. 
(c) Show that Hermite’s equation of order n has polynomial solutions of degree n 
for each integer n > 0, and that up to constant multiples there is precisely one such 
solution for each n. 

#26. Use the method of undetermined coefficients to show that Bessel’s equation of order 
zero has a solution Jo which is analytic on the entire x-axis and satisfies the 
condition Jo(0) = 1. 


6-6 FURTHER EXAMPLES 


In certain respects the exercises and examples in the preceding section were some- 
what too special to be completely representative of the power series method for 
solving linear differential equations. For one thing, all of the coefficients in each 
of these equations were polynomials—which hardly qualify as typical analytic 
functions. And for another, each of the recurrence relations we obtained led 
immediately to a general formula for the coefficients of the series being sought. 
In many cases neither of these simplifications occur, and in order to put this 
discussion in a more reasonable perspective we now present a number of less 
elementary examples. 


EXAMPLE 1. Solve the initial-value problem 


By’ -- γ τ et Dy = 1; 


yO) = γ() = 0. ere 


By Theorem 6—4 we know that the desired solution can be expressed in the form 
γα) = >> ax" (6-31) 
k=0 


for suitable constants ας, and that the resulting series will converge on (— οὐ, 0). 
Thus we substitute (6-31) and its first two derivatives in the given equation to 
obtain 


Σ, 3Κ(Κ -- 1)α,ρχ’ 2 -- ye ka,x*—! + bs a,x? th + Σ, a,x” = 1, 
k=1 k=0 k=0 


k=2 
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or, after shifting indices of summation, 
Σ) 3( + 2k + Wanyex” — Σ) (kA Vang ix" 


k=0 k=0 
= k = k 
-+ >) ay 1x + >> ax ae 
k=1 k=0 
Collecting terms we have 
δας — ay + a 


- >. [3(K + 2)(K + lange — (k + Wakga + ay, + ἀκ. εχ = 1, 


k=1 


and it now follows that | 
6a2 — αι + ἀρ = I, 
3(k + 2)(k Ἢ 1)ακ. = (k + 1)αμ.ε1 + ak + ἀκ...1 = 0, k > 1. 


In addition, by setting x = 0 in (6-31) and its first derivative, and using the 
given initial conditions, we find that ag = a, = 0. Hence 


— ‘os oe? 8 
ao = 0, αι > 0, ἄς >= 6? 
and, in general, 


= Ak+1 - ay + ακ..1 ; 
742 = 3042) 3+ DE+D ΓΞ 


Here, for the first time, we are confronted with a recurrence relation which 
cannot be solved for a, as a function of k alone. As suggested above, this is not 
at all uncommon, and when it occurs we have no choice but to compute a few 
terms of the series involved and then use Theorem 6—4 to determine a (minimal) 
interval of convergence. In point of fact, this is usually sufficient for most pur- 
poses, since it is always possible to develop the series to the point where it can be 
used in numerical work. 

In the present case we have 


a3 = τ. 


324> 5 — "T2753 
and 
.-.- ..2 .1 χϑ 4. 4 4,86 ἐξ κοῦ 
)7(Χ) = ἐχ' Ὁ 54% — 3aqx 1215* ’ 


an expression which already furnishes an excellent approximation to the required 
solution in the interval (—1, 1). 


EXAMPLE 2. Solve the initial-value problem 


xy + ¥ + xy = 0; 


yY=90 γνῷ - -1. mee 
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Here we begin by making the change of variable u = x — | to shift the com- 


putations to the origin. Then 
dy_dy, dy _ dy 
du dx du2 dx? [9:.99) 


and (6-32) becomes 
(u + ἼΑ ΤῸ; + (ut Dy = 0; 


y0)= 90, γ΄) - -Ἰ. 


Substituting 
ylu) = >. ayu 
in this equation we obtain 
(u+ 1) >> k(k — 1)a,u"—? + Σ kau’! + (u+ 1) δ au" = 0, 
k=2 k=0 


or, after the usual simplifications, 


ay + ay + 262 
ἘΝ Σ; [(ἀ + 2)(k + Ἰγακ..2 + (K + 1)7an414 + ae + ay,—1]u" = 0 
k=1 
Thus 
ay + ay + 2a, = 0, 
(kK + 2)(K + Wanye + (K+ 1)?ap41 + a, + a1 = 0, k21 
and since the initial conditions imply that a9 = 0, a, = —1, we have 
do = ἃ, ag = --ἶ, a4 = ¢ 
Hence 
yu) = —u + du? — gu + hut to, 
and, setting u = x — l, 
A(x "ΙΝ 1)4 + 


yx) = 1— x + Hx -- ἡ — ἰὰ - 1° + 
From Theorem 6—4 we conclude that this series converges at least in the interval 
0 < x < 2. since this is the largest interval centered at x9 = 1 in which the 


equation is normal. 
EXAMPLE 3. For our final example we solve the initial value problem 


mW __ ety = (, 
jae (6-34) 


yO) = y@) = 1, 


involving an equation with nonpolynomial coefficients 
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As usual we start by substituting 
γα) = Σ᾽ a,x" 
k=0 
in the given equation. This yields | 
>, Kk — Wazx*-? — e® > ax* = 0, 
k=2 k=0 
which we rewrite as 


re) 00 k 00 
2 ( + 2k + lazyox* -- (> 3 ( sn) =0.* (6-35) 


In order to put this expression in the form required by the method of undetermined 
coefficients (1.6., a power series in x), we now use the theorem which asserts 
that power series may be multiplied according to the usual rules of algebra within 
their common intervals of convergence. Thus 


2 
(a + ax tans? (14 e+ 5. Ὁ.} 
= ag + (ao + αι)χ + ($04 ay + a, )x? 


+ ($+ $+ a + a5)s° Ὁ 00 


Substituting this expression in (6-35) we obtain 


οΌ k a; 
Σὰ + 2)(K + Ἰγακ..5 -- ea x = 0, 


and it follows that 


_ Ι Gy 
Me EF DEFD EE Γ᾽ ΤῸ 


In particular 9 
Qg = “Ὁ 
2 ' 


a a 
pe OT, 


_ 1 (4 _ ag + ay 
αι = 35 (38 + a: + 2) = a2 


“Recall that e? = 1 + x + x?/2! + x3/3!4--- 
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etc., and in principle all of the a, can now be computed in terms of ao and a}. 
Finally, since the initial conditions in effect imply that a9 = a; = 1, we have 


ee | 
ao = 4; 
= "ἢ 
ag = 3. 
ee | 
a4 = 5: 


and 
4 


a a 
WA) ΞΡ τς τ: 


The validity of the above computations obviously depends upon the fact that 
convergent power series can be multiplied as though they were polynomials. Since 
we shall have occasion to refer to this result again we now state it precisely and 
formally as 


Theorem 6-5. Let 
De a,x" and > b,x" (6-36) 
k=0 , 


k=0 


be convergent in the interval |x| < r,r > 0. Then the series 


» c,x", (6-37) 
k=0 
with 
k 
Ck = >» ajby—j, (6-38) 
=O 


known as the Cauchy product of the series in (6-36), also converges for 
|x| <r, and 


>> ax" \( > bx* |) = δ c,x" (6-39) 
k=0 k=0 k=0 
for all x in this interval. 


When phrased in terms of analytic functions this theorem asserts that the 
product of two functions fand g which are analytic on an interval J is itself analytic 
on J, and that its power series expansion about any point xo in J is the Cauchy 
product of the power series expansions of f and g about Xo.* 


* For a proof the reader should consult Buck, Advanced Calculus, 2nd Ed., McGraw- 
Hill, New York, 1965. | 
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EXERCISES 
Find the first four nonzero terms in the series expansion of the solution of each of the 


following initial value problems, and determine a (minimal) interval. of convergence for 
the series. 


1. γ΄ + (sinx)y = 0; 2. 2ν" — γ΄ + (x + ly = 0; 
y(O) = 1, yO) = 0. γ(0) = 0, yO) = 1. 

3. (( - Dy’ + yp’ + xy = 0; 4. 2γν'" — xy = cosx; 
γ(0) = yO) = --Ἰ. )00) = yO) = 0. 

5. 1 — 4x?)y” + x?y’ — 2y = 0; 6. (cos x)y’"’ + 2xe*y = 0; 
yO) = yO) = 1. y(0) = 0, yO) = 1. 

7. (x — 3)y" + x*y' + y = 0; 8. (1 + In(l + x)Jy” — xy’ + y = sin x; 
y(0) = 0, yO) = 6. y(0) = 0, yO) = 1. 

9. xy’ — y = 0; 10. xy’ + yp’ + xy = 0; 
y3) = γ΄ 9) = 0, γ΄) = 9. γ() = 0, γ΄) = --Ἰ. 

11. 3γ᾽ — xy’ + x?y = οἷ; 12. 3χγ' — y’ = 0; 
yO) = yO) = 0, γ΄ (0) = 1. y(—2) = 1, y'(-2) = —-1. 


13. Find the first four nonzero terms in the power series expansion of 


μη — ¢2 
[ eat. 
0 


What is the interval of convergence of the power series expansion of this integral? 
14. Let 


CO 
y(x) = >» ax” 
k=0 


be a solution of the equation 


» + p(x)y' + a@&)y = 0 


in the interval |x| <r, r > 0, and suppose that 


= k = k 
P(x) = > PiX, α(χ) = dS ax 
k=0 k=0 
in this interval. Prove that 


1 
— (k + DK - 2) 


fork = 0,1,2,.... 


ακ- 2 = 


k 
> [ὦ + 1) pe—saj41 + qe—sajl, 
j=0 


7 


euclidean spaces 


7-1 INNER PRODUCTS 


Much of the content of elementary geometry depends upon the ability to measure 
distance between points. In this chapter we shall show how distance, together 
with such related concepts as length and angular measure, can be generalized to 
arbitrary real vector spaces. These so-called “metric” concepts are the foundation 
of Euclidean geometry, and from them flow a wealth of results in both geometry 
and analysis. 

In order to introduce a metric into a real vector space we must first choose a 
unit of distance for our measurements. This can be done most easily by defining 
what is known as an inner product on a vector space. The logic behind taking the 
notion of inner product as primitive will become compelling once we have used it 
to define length, angular measure, and distance. For each of these concepts then 
appears as a natural consequence of the notion of inner product, and the student 
is led to appreciate them as an elaboration of a single idea. 


Definition 7-1. An inner product is said to be defined on a real vector 
space U if with each pair of vectors x, y in Ὃ there is associated a real 
number x + y in such a way that 


x°y= yx, (7-1) 

(ax): y = a(x-y) for every real number a, (7-2) 
(x; + Xo)*y = ΧΙ Υ + Xe’, (7-3) 

x-x >0, and x-x = 0 ifand only ifx = 0. (7-4) 


A vector space with an inner product is known as a Euclidean or inner 
product space, and the real number x - y (read “x dot γ᾽) is called the inner 
product of x and y.* 7 


* Some authors call x - y the ‘“‘scalar product” of x and y. We shall avoid this termi- 
nology, however, because of the possibility of confusing it with scalar multiplication as 
introduced in Chapter 1. 
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If we apply Eq. (7-1) to (7-2) and (7-3), we see that an inner product also 
satisfies 


X°(¥i + Yo) = X-¥Yi + X-yo and == x: (ay) = a(x-y). (7-5) 
Even more generally, we have 


(1X1 + a2X2)* (Bi¥1 + BoY2) = αιβι(Χι γι) + 1B 2(K1- Yo) 


(7-6) 
+ a2B1(Xe*Y1) + a@2B2(X2° Yo), 


where αἴ, a2, 81, Bg are arbitrary scalars. For future reference we also note that 
x-y = 0 whenever x= 0 or y= 0. (7-7) 


[The proofs of (7-6) and (7-7) have been left to the reader in Exercises 6 and 7 
below. ] 

Equation (7-1) in the above definition asserts that an inner product is a com- 
mutative or symmetric operation on pairs of vectors. Equation (7-2) may be 
interpreted as an associativity requirement, this time with respect to scalars, while 
(7-3) requires that the operation be distributive. These two conditions, together 
with their analogs given in (7-5), are said to make the inner product bilinear. 
Finally, (7-4) is referred to by saying that an inner product is positive definite, 
the allusion here being to the fact that the inner product of a vector with itself is 
always greater than zero unless the vector involved is the zero vector. Thus one 
frequently hears an inner product called a real-valued, symmetric, bilinear, positive . 
definite operation on pairs of vectors. 


EXAMPLE 1. Let x = (x1,..., Xn) and y = (y1,..., Jn) be vectors in ®”, and 
define x - y by 
X°VY = Xu tees + Xnyn- (7-8) 


Then ®” becomes a Euclidean space, and as such is called Euclidean n-space. 
In @? and &? this inner product is none other than the familiar “dot product” 
of physics, where the definition is usually phrased geometrically as the product 
of the length of x, the length of y, and the cosine of the angle between them. The 
equivalence of these definitions will become apparent in the next section (see 
Eq. 7-21). 


EXAMPLE 2. This example furnishes the first intimation of things to come in 
analysis. The vector space in question is @C[a, b], the space of all continuous 
functions on the interval [a, b], with f - g defined by 


f-e- [ ” fe) g(x) dx. (7-9) 


It is not difficult to show that (7-9) satisfies all of the requirements for an inner 
product. Indeed, it is perfectly obvious that f-g is both real-valued and sym- 


258 | EUCLIDEAN SPACES | CHAP. 7 


metric, while bilinearity follows from the equations 


| [ : af(x)g(x) dx = a [ ° f(x)g(x) dx, aa real number, 


and 
b b b 
[στῶ + f@Me@) dx = f° ACs) dx + [ fo@)a(@) dx. 


Finally, if we recall that the integral of a non-negative function is non-negative, 
and that the integral of a continuous non-negative function is zero if and only if 
the function is identically zero (see Exercise 12), we see that 


{f= [κα > 0, 


and 
f-f = 0 ifand onlyif f = 0. 


Hereafter whenever we refer to ®” or C[a, Ὁ] as Euclidean spaces, we shall 
assume that we are using the inner products defined in the above examples unless 
express mention is made to the contrary. 


EXAMPLE 3. Let r be a non-negative function in C[a, b] which vanishes at most 
at finitely many points in the interval [a, b]. Then 


fe [ ” fooe(xr(x) dx (7-10) 


also defines an inner product on C[a, b]. The function r is called the weight 
function for this inner product, and we note that when r is identically equal to 1, 
(7-10) reduces to the inner product defined in Example 2. We shall meet this 
inner product again when we study boundary value problems for differential 
equations. | 


EXAMPLE 4. Let Φ be the vector space consisting of all polynomials in x with 
real coefficients. In most of our prior discussions of @ we have considered its 
vectors as objects in and of themselves, and have ignored their interpretation as 
real-valued continuous functions defined on the entire real line or any of its sub- 
intervals. From now on, however, we shall consider the members of Φ as poly- 
nomial functions in order that Φ may be viewed as a subspace of C[a, δ] for any 
pair of real numbers a < b. In this case we must define the inner product on @ 
by (7-9) or (7-10) according as one or the other of these products is being used 
in C[a, δ]. (Similar remarks apply to each of the vector spaces @,.) 


In the preceding example we mentioned the notion of a subspace of a Euclidean 
space. The relevant definition is obvious: A Euclidean space ‘W is a subspace of a 
Euclidean space Ὃ if W is a subspace of U as defined in Chapter 1, and if the inner 
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product defined on ἊΨ coincides with the inner product defined on U. It is clear 
that an arbitrary subspace W of a Euclidean space Ὃ is always a subspace of Ὁ 
in this sense provided we use as the inner product on W the one that is defined 
on 0. However, it is equally clear that it is possible to furnish ἊΝ with an inner 
product which differs from that defined on VU, in which case Ἂν, as a Euclidean 
space, is not a subspace of 0. The reader should be able to construct examples 
involving Φ and @[a, δ]. We furnish one in Exercise 10 below. 


EXERCISES 
1. Find x - y for each of the following pairs of vectors in 618. 
(a) x = (, 2, —1) (b) x = (3,1) 
y = (4, —2, 3) y = (-32,4, 2) 
(c) x = (1,2, —3) (d) x = (-- 5,0, 1) 
y = (1,3, 2) y = (1,0, —5) 
(e) x = (2, —2, 1) 
y= (, 1, 3) 
2. Find f+ g for each of the following pairs of vectors in @[0, 1]. (Recall that the inner 
product is defined by (7-9).) 
(a) f(x) = x (b) f(x) = x 
g(x) = 1 — x? g(x) = 1 -- 
(c) f(x) = sinwx/2 (d) f(x) = e? 
g(x) = cosax/2 g(x) = sinx 


(e) f(x) = |x — 34] 
g(x) = $ — |x — 3 


. Find f+ g for each of the following pairs of vectors in C[0, 1] when the inner product 


is defined with respect to the weight function r(x) = e7 (see (7-10)). 


(a) f(x) = 1 — 2x (b) f(x) = x? 
g(x) = ε Ὁ g(x) = e 
(c) f(x) = x (4) f(x) = e—*/2 sin rx/2 
g(x) = 1—x g(x) = e~*/2 sin 3rx/2 
(e) f(x) = cosax/2 
g(x) = 1 


4. Prove that (7-8) defines an inner product on 615. 


5. Letx = (x1, x2), y = (11, ¥2) be arbitrary vectors in R2. Determine which of the 


following define an inner product on 62. 


(a) x+y = x1y1 (Ὁ) x-y = 2(x1y1 + x2y2) 
(c) x-y = —2(x1y1 + χων») (ὦ x-y = (x1y1)? + (oye)? 
(6) ΧΥ = χιγι + X1y2 + xXay1 + 2xeaye (Ὁ x-y = x1iyo + xoay1 


6. Prove that Eq. (7-6) holds in any Euclidean space. 


. Prove (7-7). [Hint: Consider (0 + 0)-y.] 


260 EUCLIDEAN SPACES | CHAP. 7 


8. Let U be a real vector space, and set x- y = 0 for every pair of vectors x, y in VU. 
Is Ὃ a Euclidean space? Why? 


9. (a) Leta < a, < δι < bbe real numbers, and define f- g in C[a, δ] by 
b 
fee = [᾿ f(x)g(x) dx. 
ay 


Is C[a, δ] then a Euclidean space? Why? 
(Ὁ) Answer the same question for ®. Explain fully. 
10. In the space of polynomials Φ let 


P°q = aobo + aibi +++ + Gnbo, 


where. p(x) = ao + aix - τ + anx”, and q(x) = bo + διχ τ + δηχῆ. 
(Note that by adding terms with zero coefficients we can make any two polynomials 
in Φ have the same apparent degree, as above.) 


(a) Prove that this definition yields an inner product on @. 

(Ὁ) Is Φ with this inner product a subspace of the Euclidean space C[a, b]? Why? 
11. Let Ὃ be a Euclidean space with inner product x: y. 

(a) For each pair of vectors x, y in U let x o y be defined by 


xoy = 2(x-y). 


Prove that this definition yields an inner product on VU. 
(Ὁ) Let a be an arbitrary real number, and define x  y by 


xoy = a(x-y). 


Determine those values of a for which this definition yields an inner product on V. 
*12. (a) Let fbe a continuous function on the interval [a, b], and suppose f(xo) > 0 for 

some Xo in this interval. Use the definition of continuity to prove that f(x) > 0 
for all values of x in some subinterval of [a, b] containing the point xo. 
(Ὁ) Use the result in (a) to prove that in C[a, b] ἢ > 0, and thatf-f = 0 if and 
only if f = 0. 

13. Prove that (7-10) defines an inner product on C[a, 5}. 

14. Will (7-10) define an inner product on @[a, δ] if we merely require r to be non- 
negative on [a, b]? Why? 

15. Letr be any function in C[a, δ] which vanishes for at most finitely many values in the 
interval [a, b]. Prove that 


b 
f-g = [ f)g(x)|r(x)| dx 


defines an inner product on C[a, 5]. 
*16. Letx = (x1, x2) and y = (y1, y2) be vectors in R”, and let 


Gs ( a) 
α::) = 
7 a21 a22 
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be a 2 Χ 2 matrix whose entries are real numbers. Set 
X*Y = 411X1¥1 + 412X1y2 + a2ix2y1 + a22x2yo. (7-11) 


(a) Show that this definition satisfies Eqs. (7-2) and (7-3) of Definition 7-1 for 
every 2 Χ 2 matrix (a,;). 

(Ὁ) Show that Eq. (7-1) is satisfied if and only if aig = a2 [i.e., if and only if (a;;) 
is a symmetric matrix], and hence deduce that (7-11) defines an inner product on 62 
if and only if (a;;) is a 2 Χ 2 symmetric matrix such that 


2 2 
ay1X1 + (ai2 + aeo1)x1x2 + a22x2 


is non-negative for every choice of x; and xe, and is zero if and only if x; = x2 = 0. 
(c) Find a matrix (a;;) which reduces (7-11) to the ordinary inner product on ®?. 
(d) Determine which of the following matrices can be used to define an inner product 


on R?: 
2 1\ (-1 οἡ (1 1). 
1 1 1 O 1 1 


*17. Generalize the preceding exercise to ®”. 
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In this section we fulfill our promise to define length, angular measure, and dis- 
tance in terms of the inner product on a Euclidean space. Each of these concepts 
has a well-defined meaning in Euclidean 2-space, and it is reasonable to demand 
that any definition we adopt reduce to the familiar one in ®”. Thus we can obtain 
acceptable definitions by rewriting the relevant formulas from analytic geometry 
in terms of the inner product on ®?, and then adopting the results as definitions 
for arbitrary Euclidean spaces. 

Turning first to the notion of length, let x = (x1, x2) be any vector in ®”. 
Then the length of x, denoted by ||x||, is the non-negative real number 


Ix] = Vxi + x3 


(see Fig. 7-1). But this expression may be 
rewritten in terms of the inner product 
on 6.5 (Formula 7-8) as 


[xl] = Vx-x, 


and we have our first definition. 


ix|=\8 


FIGURE 7-1 


Definition 7-2. The length (or norm) of a vector x in a Euclidean space is 
defined to be the non-negative real number 


|x|] = Vx-x. (7-12) 
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Thus, in particular, the length of a vector x = (X,..., Xn) in ®” is 


[xl] = Vat +--+ + xp, (7-13) 


while the length of a vector f in C[a, δ] is 
| b 
Il = (f fey? dx)". (7-14) 
Next, we observe that if x and y are any two nonzero vectors in ®?, the formula 


x ° y 
cos@é@ =~? 0 “490 « π, 7-15 
Ixy) 5557 2) 


is an immediate consequence of the law of cosines (see Exercise 6). But the ex- 


pression 
xX . 


y 
IIx lly 


is also meaningful in an arbitrary Euclidean space, a fact which suggests con- 
sidering (7-15) as a reasonable candidate for the general definition of cos 0. 
Before acting on this suggestion, however, we must establish the inequality 


xy 
ee ae 7-16 
< kM * Ce 


Λ 


--] 


for every pair of nonzero vectors in a Euclidean space, since, of course, any 
definition of cos 6 must satisfy the inequality —1 < cos @ < 1. This fact will 
emerge as a consequence of the following important result, known as the Schwarz 
or Cauchy-Schwarz inequality. 


Theorem 7-1. (Schwarz inequality.) Jf x and y are any two vectors in a 
Euclidean space, then 


(x+y)? < &-xy-y). (7-17) 


Proof. We first observe that this inequality is immediate if either x or y is the 
zero vector, since then both sides of (7-17) are zero [see (7-7)]. Thus it suffices 
to consider the case in which x and y are nonzero. Here we use (7-6) to expand 
(ax — By): (ax — By) where a and β are arbitrary real numbers. By (7-4) we 
have 
0 < (ax — By): (ax — By) 

= a(x-x) — 2a6(x-y) + B7(y-y), 
whence 

2aB(x-y) < a(x-x) + B*(y-y). 


We now set 
a=vJy-y and B= V/x-x. 
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This gives 
2/x-xVy-y(x-y) < 2(x-x)y-y), 


X*Y QSVX°XVy-y. 
Squaring, we obtain (7-17). J 


or 


In &” the Schwarz inequality assumes the form 


(= xs) < (S “) (x i) , (7-18) 


while in C[a, δ] it becomes 


([ f(x)g(x) dx)? < ([ f(xy dx) ([ g(x)” dx) ᾿ (7-19) 


The first of these inequalities is valid for any collection x1,..., Xn, Vi,.--5Yn 
of real numbers, and is usually called Cauchy’s inequality. It is worth remembering 
since it is often useful in deducing other arithmetic inequalities (see Exercises 9 
through 11 below). 

In the notation of Definition 7-2 the Schwarz inequality becomes 


ΙΧ "γ᾽ < [[χ]} llyl, (7-20) 


and asserts that the absolute value of the inner product of two vectors does not 
exceed the product of the lengths of the vectors. Thus 


x-y 
Txiilyt = 


whenever x and y are nonzero. But this is just another way of writing (7-16), 
the inequality needed to justify using (7-15) as a definition of cos 6, and we can 
now state 


Definition 7-3. If x and y are nonzero vectors in a Euclidean space we 
define the cosine of the angle between them to be 
xy 
(050 = ——_ 7-21 
11] ee 


If, on the other hand, one of the vectors is zero, we set cos 6 = 0. 


It goes without saying that in defining the cosine of the angle between x and y 
we have, by implication, also defined the angle in question; just take the principal 
value of the inverse cosine. 
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At this point all that remains of our original program is to define the distance 
between any two points (i.e., vectors) in a Euclidean space. Again this is done 
simply by copying the definition from ®” where the distance between x and y 
is the length of the vector x — y (Fig. 7-2). Thus 


Definition 7-4. The distance between two vectors x and y in a Euclidean 
space is, by definition, 


d(x, y) = |x — yl. (7-22) 


But is this a reasonable definition of the term “distance”? In order to answer this 
question we must first decide what properties we require of distance in general. 


X—y 


x “FIGURE 7=2 


On this score mathematicians are in agreement, having decided as follows. The 
distance between two points must be a non-negative real number which is zero if 
and only if the points coincide. It must be independent of the order in which the 
points are considered, and finally the triangle inequality, famous from plane 
geometry, must be satisfied. Thus in order to justify using the term “distance” in 
Definition 7-4 we must show that d(x, y) is a real number satisfying 


d(x, y) = 0, (7-23) 

d(x,y) = 0 if and only if x = y, (7-24) 

d(x, y) = dy, x), (7-25) 

d(x, y) + d(y,z) > d(x,z) for any three vectors x, y, Z. (7-26) 


The first three of these properties follow immediately from the definition of 
length and the axioms governing an inner product. The last, however, is not 
quite so obvious. To prove it we first establish an inequality which is of some 
importance in its own right. 


Lemma 7-1. Jf x and y are arbitrary vectors in a Euclidean space, then 


IIx + yll < [xl] + llyll. (7-27) 
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Proof. 
Ix + yl] =(«+y)-@+y)P? 
=[«-x) + 2 -0) + (ey)? 
< [(+x) + 2Vx-xVy-y+ (y-y)}'”” (by the 
Schwarz inequality) 
= [(Vx-x + νυ} 
=Vx-xtVy-y 
= ||x|| + llyll- 8 
The triangle inequality follows at once from this result. Indeed, 
Ix — zl = |«@-y+@¢—- 2}} < Ix—yl + lly — 2, (7-28) 


which is precisely what we had to show. 
Finally, we note that the distance function defined above also enjoys the follow- 
ing agreeable properties: 


d(ax, ay) = |a| d(x, y) for any real number a, (7-29) 
and 
d(x + z,y + z) = d(x, y). (7-30) 


The proofs and geometric interpretations are left to the reader. 


EXERCISES 
1. Find the length of each of the following vectors in ®4. 
(a) (1, 2, 2; 0) (b) ({, —/3, /2, 1) 
(c) (3, 4, a3, 1) (d) (2, > —2, —3) 


(e) (2, =A, 3, 3) 
2. Find the distance between each of the following pairs of points in 4. 
(a) >, - (3, 0, =4,; 5), >= (2, Z, =I, 3) 


(b) x = (7, —4, 1, 3), y= (2, 1, —4, 8) 
(c) x = (4, 1, 0, 2), , = G, 3, -ξ, 3 
(d) x = (1, ΞΕ. 0, 2), Υ -Ξ (2, Ἰ; 1, 0) 


(Οὸχ = G3.2,), y = (-, 2,3. Ὁ) 
3. Compute ||f|| for each of the following vectors in @[0, 1]. 
(a) f(x%) = x (b) f(x) = e7/? 
() ἴὉ) = 1 — x? (d) f(x) = sin rx/2 
(e) f(x) = In@ + 1) 
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4. Find the angle between each of the following pairs of vectors in 615. 
(a)x = (4,1,1), y = G, --Ι, 4) 
(Ὁ) x = (3,1, —2), y = (2,4, —8) 
(c) x = (1, —1,0), y = (2, —1, 2) 
(δ x = (0, V39, V/11), y = (1, 5, 0) 
(e) x = (-3, —1,0), y = (1,2, -V/5) 
5. (a) Find the cosine of the angle between each of the following pairs of vectors in 
Φς if the inner product is p> q = [21 p(x)q(x) dx. 


(i) 1, x (ii) x, x? (11) x, 1 — x 


(Ὁ) Repeat (a), this time using the inner product p-q = [ἢ p(x)q(x) dx. 
6. Use the law of cosines to establish that 


ΒΕ 
cos? = ΧΙ 


for any pair of nonzero vectors x, y in R? (see Fig. 7-3). 


xX—y 
x FIGURE 7-3 


7. (a) Compute f - g for each of the following pairs of vectors in C[—7, π]: 
(i) f(x) = sin mx, g(x) = sin nx, 
(ii) f(x) = sin mx, g(x) = cos nx, 
(11) f(x) = cos mx, g(x) = COs mx, 
where m and 7 are arbitrary non-negative integers. 
(b) What can you say about the functions 


1, sin x, cos x, sin 2x, cos 2x,... 


in C[—7, π] on the basis of the results in (a)? 

8. Prove that the Schwarz inequality becomes an equality if and only if x and y are 
linearly dependent. 

9, Let ai,..., Qn be positive real numbers. Prove that 


1 
@ to tan(hge $2) San. 


[Hint: Use Cauchy’s inequality.] 


*10. 


11. 


712. 


13. 
*14, 


15. 
16. 


17. 


*18. 


*19. 


7-2 | LENGTH, ANGULAR MEASURE, DISTANCE 267 


Let a,b,c be positive real numbers such that a + ὁ - c= 1. Use Cauchy’s 
inequality to prove that 


(-)(-)(-}»: 


Prove that the following inequality holds for any collection of real numbers 
Ω19.9.. ..«,ςΠᾳ. 


2 
αι τ᾿ 5" Ὁ αλλ, αἱ ἘΠ ας, 
n = n 
Let ¢ be an arbitrary real number, and consider the inequality 


0 < (x — y): (χ -- y), 


valid for any pair of vectors x and y in a Euclidean space. Expand this inner product, 
and derive the Schwarz inequality by examining the discriminant of the resulting 
inequality in t. (This is another very popular way of deriving the Schwarz inequality.) 


Prove that distance as defined in (7-22) satisfies (7-23) to (7-25). 


Set x = z in (7-26) and use (7-24) and (7-25) to deduce (7-23), thus showing that 
this relation is actually implied by the other three. 


Show that |lax|| = [α] ||x|| for all real numbers a. 


Prove that 
d(ax, ay) = |a| d(x, y) 


for all real numbers a, and that 
d(x + z,y + 2) = d(x, y). 
Use (7-27) to deduce that 
Ix + yll > {||} — Ilyll | 


for any pair of vectors x, y in a Euclidean space. 


Prove that |/x + y|| = |x|] + |ly|| if and only if y = ax or x = ay for some 
real number a > 0. 
Let 


411 412 
(aij) = 
a21 a22 
be a2 Χ 2 matrix whose entries are real numbers, and suppose that (a;;) is so chosen 


that (7-11) is an inner product on 612 (see Exercise 16 in the preceding section). 
Use the Schwarz inequality to deduce that 


2 
aji2 < a41422. 


Conversely, show that if (a;;) satisfies this inequality, and a12 = 421, then (7-11) 
defines an inner product on 612. : 
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7-3 ORTHOGONALITY 


Two vectors in a Euclidean space are said to be orthogonal or perpendicular if the 
cosine of the angle between them is zero. Referring to Definition 7—3 we see that 
the zero vector is othogonal to everything, and, in general, that x and y are orthog- 
onal if and only if x-y = 0. In a moment we shall generalize the notion of 
orthogonality somewhat, but first we prove a particularly celebrated theorem. 


Proof. 


Theorem 7-2. (Pythagoras.) Two vectors x and y in a Euclidean space 
are orthogonal if and only if 


Ix + yll? = [xl]? + Ilyll’. 


Ix + yl? =(@«+y)-@+) 
x°x + 2(x-y)+y-y 
= |x|? + 2(x-y) + |ly|l?. 


Thus ||x + y||? = [[χ|} 2 + |ly||? if and only if x-y = 0, as asserted. ἢ 


We have appended two figures in illus- x+y 
tration of this result (Figs. 7-4 and 7-5). y 
The first is certainly one of the most 
familiar and well chosen diagrams in math- 
ematics, and needs no comment. The sec- 
ond, on the other hand, has the negative 
virtue of conveying almost no information 


at all, and should stand as a warning to 
the student to exercise geometric restraint x 
in interpreting statements concerning or- FIGURE 7-4 


thogonality. 
This said, we continue the discussion by giving the following definition. 


Definition 7-5. A set of vectors xj, Xo,...,X;,...in a Euclidean space 
is said to be an orthogonal set if x; τέ 0 for all i, and 


x;°x; = 0 (7-31) 
whenever i ¥ j. If, in addition, 
x;°x; = 1 (7-32) 


for each i, the set is said to be orthonormal. 


Thus an orthogonal set is a set of mutually perpendicular nonzero vectors, while 
an orthonormal set is an orthogonal set in which each of the vectors is of unit 
length. For economy of notation when discussing orthonormal sets, Eqs. (7-31) 
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and (7-32) are frequently combined by writing 


X;°Xj = δὲν where 633 = : 7 it (7-33) 


The symbol 6;; introduced here is called the Kronecker delta. 

The distinction between an orthogonal and an orthonormal set is really trifling, 
for if we replace each vector x in an orthogonal set by the “normalized” vector 
x/||x|| of unit length, the resulting set is obviously orthonormal. The only reason 
for introducing orthonormal sets at all is for the convenience which sometimes 
results from working with unit vectors. 

Before giving examples, we call attention to two points in the above definition. 
The first is that every vector in an orthogonal (or orthonormal) set is nonzero; 
the second is that we have placed no restriction on the number of vectors in such 
sets. In particular, an orthogonal set may contain an infinite number of vectors 
(see Example 3 below). Such sets will occur repeatedly in Chapters 9 and 11. 


FIGURE 7-5 


EXAMPLE 1. In @? the vectors (1, 0, 0), (0, 2, 0), (0, 0, —4) form an orthogonal 
set, while the standard basis vectors (1,0, 0), (0, 1,0), (0, 0, 1) form an ortho- 
normal set. More generally, the set consisting of the standard basis vectors in 
®” is orthonormal. 


EXAMPLE 2. We define a trigonometric polynomial of degree 2n + 1 to be an 
expression of the form 
f(x) = ΤΙ + a,cos x + dzgcos2x +--+ + a, cosnx 


+ δι sinx + bo sin2x + τ: + δ, sin nx, (7-34) 


where do,..., 5, are real numbers, and a, τέ 0, or δ, ¥ 0, or both. Let 3, 
denote the set of all trigonometric polynomials of degree < 2n + 1, together 
with the zero polynomial. We make 3, a Euclidean space by defining addition 
and scalar multiplication of trigonometric polynomials termwise, as with ordinary 
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polynomials, and an inner product by 
f-e= [ fxg) dx. (7-35) 


The set of functions 


1, cos x, SIN X,..., COS nx, sin nx (7-36) 
is an orthogonal set in 3, since, for non-negative integers m and ἢ, 
κ ϑ .« Φ 
] sin mx sinnxdx = 0, if m 5έ ἢ, 
--᾿ 
τ » 
[ sin mx cos nx dx = 0, (7-37) 
--τ 


κ 
[ cos ΙΧ cosnxdx = 0, if mn. 
--τ 


To normalize this set we observe that 


[ " dx = 2π, 
and | (7-38) 


τ Φ κ .Θ 
[ sin? mx dx = [ cos? mx dx = x, if m> 0. 
--τ “τ 


Hence the functions 


1 COS x cosnx  sinx sin nx 
ee (7-39) 


S$eee 9 


Sie ὡς Ve we Wi 


form an orthonormal set in 3,,. 


EXAMPLE 3. It follows from the preceding example that the (infinite) set 
1, cos x, sin X,..., COS x, SiN Nx,... 


is orthogonal in C[—z, z]. 


The most important single property of orthogonal (and hence orthonormal) 
sets is that each such set in a vector space Ὃ is linearly independent. To prove this 
result in all generality we extend the definition of linear independence to include 
infinite sets by agreeing that any such set is linearly independent if and only if 
every one of its finite subsets is linearly independent in the earlier sense of the 
term. Thus, for example, the vectors 1, x, x”,... are linearly independent in the 
space of polynomials Φ. (Proof?) 


Theorem 7-3. Every orthogonal set of vectors in a Euclidean space Ὃ is 
linearly independent. 
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Proof. Let 8 be an orthogonal set in v, and suppose 
0X1 +++ + anXn = 0, (7-40) 


<i<a, 


with x,,...,Xnin$&. Then, for each index i, 1 
(ayX1 - °°* + anXn)° xX; = O-x; = O. 
But since x; +x; = 0 whenever i ¥ j, the above equation reduces to 
a(x; + ΧΟ) = 0, 


and since x;- x; γέ 0, it follows that a; = 0. Thus each of the coefficients in 
(7-40) is zero, and the assertion follows from the test for linear independence. 


In particular, we can now state the following useful result. 


Corollary 7-1. An orthogonal set is a basis for an n-dimensional Euclidean 
space if and only if it contains n vectors. 


EXAMPLE 4. In @3, with inner product 


p-q = Γ. P(x)q(x) dx, 


the polynomials 1, x, x? 


this space. 


— 4 are mutually orthogonal, and hence are a basis for 


EXAMPLE 5. We saw above that the functions 1, cos x, sin x,..., cos mx, sin nx 
are mutually orthogonal in 3,, the space of all trigonometric polynomials of 
degree < 2m + 1. Hence these functions are linearly independent in ὅ,. More- 
over since every vector in this space is a linear combination of these functions it 
follows that they form a basis for 3,, and hence that dim 3, = 2n + 1. 


EXAMPLE 6. The orthogonality of the set of functions 
1, cos x, SiN X,..., COS Mx, SINNX,... 


in C[—7, x] implies that this set is also linearly independent. Combined with the 
fact that any n + 1 vectors in an n-dimensional space are linearly dependent, we 
conclude that C[—7, π] is infinite dimensional. 


EXERCISES 


1. Verify that the Pythagorean theorem holds for the orthogonal functions sin x, cos x 
in C[—7, π]. 


*2. Let x1,...,X, be mutually perpendicular vectors in a Euclidean space. Prove that 
Ika evs + Xal]? = [fxal]? + °° + [xall?. 


(This result is a generalized version of the Pythagorean theorem.) 


272 


1. 


Ἐ14. 


. Find ἃ vector of unit length in 6.5 which is orthogonal to the vectors x 
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. Prove that the polynomials 1, x, x? — 4 are mutually orthogonal in @3 with the 


inner product defined as in Example 4 of the text. 


. Let x be a nonzero vector in a Euclidean space. Show that the vector x/||x]| is of 


length 1. 


. Convert the orthogonal set of Exercise 3 above into an orthonormal set. 
. Find a polynomial of unit length in @3 which is orthogonal to 1 and x. (Use the 


inner product of Example 4 of the text.) 


. Find a polynomial of degree 3 which is orthogonal to 1, x, x? in @4. (Use the 


inner product of Example 4 of the text.) 


I 


(1, = 0), 
ΒΟ 1A), 


. Find a vector of length 2 in ®* which is orthogonal to the vectors x = (1, 0, 3, 1), 


= (—1,2,1,1),z = (2, —3,0, —1), and has 0 as its second component. 


. Let x and y be linearly independent vectors in ®?. Prove that there exist precisely 


two vectors of unit length which are orthogonal to x and y. 


. Find a linear combination of the functions οἴ and e~* which is orthogonal to e* in 


e[0, 1]. 


. Let x and y be arbitrary vectors in a Euclidean space, and suppose that ||x|| = |ly|]. 


Prove that x + y and x — y are orthogonal. Interpret this result geometrically. 
Suppose xj, ...,Xn is a finite orthonormal set in a Euclidean space U. Prove that 
for any vector x in UV 


n 


Σ᾽ α΄ χὸ < ΠΧ] 


ἐπεὶ 


[Hint: Set y = x — Σ ἢ (x-x,)x;, and compute |ly||?.] 

This inequality is a special case of Bessel’s inequality which will be proved in general 
in Section 8-4. 

Let x1, ...,Xn be an orthonormal basis for a Euclidean space VU. 


(a) If x is any vector in VU, prove that 


nT 
2 2 
IIx? = >> @&-x,)”. 


i=1 


This result is known as Parseval’s equality, and will be proved in more general terms 
in Section 8-4. 
(Ὁ) If x and y are any two vectors in VU, prove that 


= > (x + x,)(y - Xi). 


i=l 


(c) Prove, conversely, that if x1,...,X» is an orthonormal set in a finite dimensional 
Euclidean space VU, and tf the equality in (b) is valid for every pair of vectors x, yin'‘U, 
then x1,...,X, is a basis for VU. 
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7-4 ORTHOGONALIZATION 


We now know that every orthogonal set of vectors in a Euclidean space is linearly 
independent (Theorem 7-3). However, this result would be of only passing 
interest were it not for the fact that a Euclidean space also contains “enough” 
orthogonal vectors to enable us to replace a given linearly independent set by an 
equivalent orthogonal one. More precisely, in this section we shall prove that any 
(finite or infinite) linearly independent set X in a Euclidean space can be con- 
verted into an orthogonal set which spans the subspace S$(X). This process of 
orthogonalizing a linearly independent set, as it is called, has a number of im- 
portant and useful consequences, not the least of which are the computational 
simplifications which result from working with orthogonal vectors. 


Χο 
€2 = Xzq— ae} 


ΧΙ =e ———~e 
yey ae] 1 


FIGURE 7-6 


Rather than begin with the most general situation, we shall introduce the 
orthogonalization process by two examples. The first is drawn from ®? where 
we consider a pair of linearly independent vectors xj, Χο. Then x; and x2 form 
a basis for ®?, and in this case our problem becomes that of replacing x, and Χο 
with an orthogonal basis 61. 6. constructed out of x, and Χο in some reasonable 
way. Figure 7-6 suggests the most natural solution of our problem; simply take 
61 = Xj,, and then let 62 be the “component” of x2 perpendicular to x,;. Thus 
we write 6.0 in the form 

€2 = Χο — ae), 


and then determine a so that the orthogonality condition e2-e, = 0 is satisfied. 
This yields the equation 


Xe; — a(e,-e,) = 0, 


and hence the value of a is 
Xg° ej 


€;,° ey, 


— 


With this, eg has been determined in terms of x; (= 6:1) and Χο, and the basis 
X1, X2 in ®” has been orthogonalized. 
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EXAMPLE 1. If x, = (1, 1) and x» = (0, 1), then 


_ ©0,1)-0,1) 1 
— (1,1).6,1) 2 


a 3 


and so 
e, = (1,1), e2 = (—3, 9). 


Figure 7-7 shows that this is exactly the result one would expect on the basis of 
our earlier remarks. 


| FIGURE 7-7 


As our second example we orthogonalize an arbitrary basis x1, Xo, x3 in 615. 
The procedure is essentially the same as that used above in ®%, and is started by 
choosing e; = x,. The second step consists of determining e2 according to the 
pair of equations 

6.16: = 0, C2 = X22 — ae), 
which gives again 
eps a 
€y,° ey 


It is clear that 6. is not the zero vector (why?), and also that 6; and 62 both 
belong to the subspace of 61 spanned by x; and Χο. Hence S(e,, 62) is a subspace 
of 8(x1, Χο). Moreover, since the orthogonal vectors 61, e2 are linearly inde- 
pendent, S(e;, 62) has the same dimension as 8(x1, Xo). Thus 


S(€1, 62) = 8(X1, Xe). 


Combined with the fact that x1, x2, X3 form a basis for ®°, this equality implies 
that x3 does not belong to the subspace of ®® spanned by e; and eg. Referring to 
Fig. 7-8, it is again geometrically clear that the orthogonalization process 
ought to be completed by letting 65 be the component of x3 perpendicular to the 
subspace S8(e1, 62). Thus we set 


€3 = X3 — @j€; — Ala, 
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FIGURE 7-8 


€3 = Xz — (ae;  α262) 


and find a, and ας by means of the orthogonality conditions 61" 62 = 6163 = 


62. 64 = 0. They yield the pair of equations 


O = χε. 61 — ai(€1- 1) 


and 
O = x3°@€2 — ao(€2° 2), 
whence 
X3° ey Xg° Co 
ay = —— 3 a2 = —— 
᾿ 61:06, €2° Co 


This completes the orthogonalization of the basis x1, Xo, X3. 


EXAMPLE 2. Let x, = (1, 1,0), x2 = (0, 1,0), x3 = (1,1, 


1). Then Ce, = Xi, 


6. = Xo — ae), and 63 = X3 — α|δ| — ae€e2, where a, aj, and ας are found 


from the equations 


Χο Θ᾽ _ X3° 1 _ X3° €2 
= ——— 9» = — > αὸ Ξξο -- -- 
6156) Q,° ei C2 * Co 
| 
| 
7 
» το.) 77! 
΄ we Ι 
΄ ΄ Ι 
ΞΕ ΞΞ τ Σ Ι 
᾿ ΚΖ τ (0, 
Ι ἢ ] 
| “τί 59999) 
7 ἘΣ, 
A lv 
7 7 
ee ιν A - x; =e, = (1,1,0) 


Ν 
Ν 


FIGURE 7-9 
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It follows that a = 4,a, = 1, ag = 0, and 
οι: = (, I, 0), 6. = (—4, 3, 0), €3 = (0, 0, I) 
(see Fig. 7-9). 


We can now quickly dispose of the general situation in which we are required 
to orthogonalize an arbitrary set of linearly independent vectors ΧΙ, xo,... 
in a Euclidean space. First sete; = x ,, and then let 6.0 = x2 — ae,, where ais 
so chosen that e;-e2 = 0. This determines a as (x2-e,)/(€;-e;), and the 
linear independence of x; and x2 implies that e2 ~ 0. Furthermore, arguing as 
above, we see that S(e;, €2) = S(X1, Xo). 

It remains to show that this process can be continued indefinitely step by step.* 
To do so, suppose that we have already constructed an orthogonal set e,,..., en 
out of x;,..., X, So that S(e;,...,@n) = S(x1,...,X,). Then, to continue one 
step further, set 


Cn+1 = Xn41 στ ατῦ' — A2€qg — 5" — An€n, 


and determine aj,...,a, so that e,,, is orthogonal to each of e;,..., en. 
This leads to the equations 
Xn41°@1 — a3(€1° 61) = 0, 


Xn+4+1°€2 τ a(€2*€2) = 0, 


Xn41° Cn — An(en . e,) = 0, 
and so to 


st UE ye, a i oe ὼ..Ὁ 


€1,° ey C2 ° Co Cn " Cn 


which determines 6,..1- Again the linear independence of xj,..., Xn41 implies 
that en, 1 ~ 0, and, as before, we can show that 8(e),...,@n41) = S(K1,.-~. »Xn41)- 
(See Exercise 9 below.) Thus the orthogonalization process has been continued, 
as required, and we can now state the following important result. 


Theorem 7-4, Let x1, Xo,...be a (finite or infinite) set of linearly inde- 
pendent vectors in a Euclidean space Ὃ. Then there exists an orthogonal 


set @1,@2,...in U such that for each integer n, 8(€1,...,@n) = 8(X1,..., Xn)- 
Moreover, the e, can be chosen according to the rule 
Qe; = Xi, (7-41) 
and, 
Cn41 = Xn+1 — A101 ~ °°" —~ An&y, (7-42) 


* The knowledgeable reader will recognize that we are giving a proof by mathematical 
induction at this point. 
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where 


_ Xn41° ΘΟ. 


Xn-+1 ᾿ ei Xn+1 τ Cn 
_—_ SS An -«-φ- —————- « 


a = . 
: Q, °ey Ξ Θθο "9 6," Cn 


(7-43) 


The method of orthogonalization described in this theorem is known as the 
Gram-Schmidt orthogonalization process. 


EXAMPLE 3. In this example we apply our orthogonalization process to the 
infinite linearly independent set of vectors 


2 
| (Pike, Mee sia rege 


in the space of polynomials Φ with inner product defined by 
1 
pea =f p(x)q(x) dx. (7-44) 


The orthogonalization goes as follows: 


ὍΣ Ὄπ | 


1 
e,°e =| &-= 7: 


" 1 
(ii) ὁ. = x — a, wherea = § [4 x dx = 0. 


Thus 
Co = xX 
1 2 
6.0 "0. = [ χ' dx = &. 
a 
(iii) eg = x? — αι — aox, where 
1 2 1 3 ὩΣ. 
a=3f dx -- 4, a= $f x dx τὸ 
— =| 
Thus 


Fo SR Bey A 2 
1, x, x? — 4,x° — Bx, x* — ὃχ' + se, ... (7-45) 


in Φ. 
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When supplied with appropriate multiplicative constants these polynomials 
become the famous Legendre polynomials of analysis. (Also see Section 6-5.) We 
shall meet them again in Chapter 11, where they will be discussed in greater detail. 
At this point we merely ask the student to make a mental note of the fact that the 
Legendre polynomials form an orthogonal set in Φ when the inner product is 
defined by (7-44). 

Theorem 7-4 has a number of useful consequences, the first of which though 
obvious is nonetheless useful. 


Corollary 7-2. Every finite dimensional Euclidean space has an orthonormal 
basis. ; 


This result will enable us to simplify many of our future computations. In 
particular, if e,,...,¢€, is an orthonormal basis in an n-dimensional Euclidean 
space VU, and if 


X = ay@; t°'' + an€n 
is any vector in VU, then since e;-e; = δὲ)» 
X°C; = a; 


for each integer i, 1 < i <n. Thus every 


toe eae ee et σεν). 


vector X in Ὃ can be written uniquely in the Xo | 
form 7 
a 
7 
Χ = (x-e,)ey ἘΠ + (Χ - en)en, 
(7-46) ,΄ FIGURE 7-10 


΄ 
΄ 


and it follows that the coordinates of x with respect to an orthonormal basis in U 
are simply the various inner products of x with the basis vectors. When inter- 
preted geometrically, these coordinates are just the lengths of the projections of x 
onto the coordinate axes, as shown in Fig. 7-10. 

Finally, if 
yO, + °° + Anen 


x 
and 


y = Bye; + τ: + Bren 


are any two vectors in U, their inner product is 
ΧΟΥ = a181 + °°* + anBn. (7-47) 


Verbally, this result may be expressed by saying that the inner product of two 
vectors in a finite dimensional Euclidean space is the sum of the products of their 
corresponding components when computed with respect to an orthonormal basis for 
the space. The reader ought to compare this result with Example 1 and Exercise 
10 of Section 7-1. 
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EXERCISES 


1. 


Orthogonalize each of the following bases in ®?. 

(a) (1,1,0), (—1, 1,0), (—1, 1, 1). (Ὁ) (4, 0, 2), (—1, 3, 1), (2, 1, 4). 
(c) (2, —1,1), (5, —2, 3), (1, 0, 1). (ὦ (4,2, —1), (2,0, 3), (0, 4, 1). 
(e) (1,0, 0), (0, 1,0), (—1, 0, 1). 


. Continue the orthogonalization process in Example 3 above and show that 64 = 


4 


8. 8 ὡς — 8.2 3 
x =x,ande5 = x yx" + ae. 


. Orthogonalize each of the following bases in @4. 


(a) (1, 0, 0, 1), (-1, 0, 2, 1), (0, 1, 2, 0), (0, 0, —l, 1). 
(b) (2, 0, 3; 1); (0, 0, 3, 1), (1, 0, -51, 1), (, 1, 0, — 3). 
(c) (1,0, 0,0), (1,1, 0,0), (1, 1, 1,0), C1, 1, 1, 1). 


. (a) Orthogonalize the basis 1,x — 1,(x — 1)? in ©3 with inner product 


S21 p@das) ax. 
(b) Repeat (a), this time using the inner product AF P(x)q(x) dx. 


. Orthogonalize each of the following sets of vectors in @[0, 1]. 


(a) 65,6. (Ὁ) e, 675 (c) 1, 2x, e* 


. At one point in this section the following argument was used: If W is a subspace of 


an n-dimensional vector space U, and dim W = n, thenW = VU. Prove this state- 
ment. 


. In @ define p> q by 


Ρ᾽4ᾳ = aobo + ab, sy Sa oa Anbn, 
where 
p(x) = ao + aix - τ" + apx’, 
q(x) = bo + bix τ τ + bax". 
(See Exercise 10, Section 7-1.) If a is an arbitrary constant, show that the polyno- 
mials 


1,x — a, (x — a)?,...,(« — a)",... 


are linearly independent in @, and then orthogonalize this set. 


. Orthogonalize the basis 
οἱ = (1,0,...,0), 
e, = (1,1,...,0), 
e, = (1, 1, 9 1), 
in Θ΄. 


. In passing from step 2 to n + 1 in the orthogonalization process (Theorem 7-4) we 


had the following situation: 
(i) S(e1,...,@n) = S(K1,...,Xn), with e1,...,e, mutually orthogonal, and 


(ii) Cn41 = Xnz1 — @1€1 — *** — Gan, Where aj,...,a@, are computed 
according to (7-43). : 


280 


10. 
11. 


12. 


13. 


14. 


15. 


16. 


17. 
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It was then asserted that 
(a) 6,..1 ¥ 0, and 


(b) S(e1,..-, 6.4.1) = S(K1,..-,Xn41). Prove these statements. 

Write out a proof of Eq. (7-47) of the text. 

Let e1,..., 6, be an orthogonal basis in a Euclidean space Ὁ. 

(a) If x = aye, +°:* + ane, is an arbitrary vector in VU, find the value of a; in 


terms of x and e;. 
(Ὁ) Compute x - y for any pair of vectors x and y in Ὁ. 
A vector x in a Euclidean space Ὃ is said to be perpendicular or orthogonal to a sub- 
space Ὃν) of Ὃ if x is orthogonal to every vector in VU. 
(a) Show that at each step in the Gram-Schmidt orthogonalization process e, +1 is 
orthogonal to the subspace S(x1, .. . , Xn). 
(Ὁ) Suppose e1,..., €n is a basis ἴογ Ὁ). Prove that x is orthogonal to‘W if and only 
if x is orthogonal to each of the e;. 
Find a vector of unit length in 613 which is orthogonal to the subspace spanned by 
the vectors (1, 2, —1) and (—1, 0, 2). (See Exercise 12.) 
(a) Orthogonalize the set of vectors 1, sin x, sin? x in @[—7, 7]. 
(b) Use the result in (a) to find a unit vector which is orthogonal to the subspace of 
Θ[--π, π] spanned by 1, sin x. (See Exercise 12.) 
(a) Let e1, e2 be an orthonormal set in a Euclidean space U, and let W be the sub- 
space spanned by 6: and eg. Ifx is an arbitrary vector in VU, prove that there exists 
precisely one vector y in ‘W such that x — y is orthogonal to W (see Exercise 12). 
(b) Find y if Ὃ = 6.8, ει = (1,0,0), e2 = (0, /2/2, 2/2), and x = (1,1, 1). 
Let po(x), pi(x), ..-, Pn(x), ... be the sequence of polynomials obtained by ortho- 
gonalizing the sequence 1, x, x”,...in C[—1, 1]. 
(a) Prove that p,(x) is a polynomial of degree , for each n. 
(Ὁ) Prove that the leading coefficient of p,(x) is 1. 

*(c) Prove that when πὶ is even, p,(x) contains only terms of even degree, and when κ 
is odd, p,(x) contains only terms of odd degree. [Hint: Use mathematical induction. ] 


Legendre polynomials. The Legendre polynomial P,(x) may be computed by the 
following general formula where n successively assumes the values 0,1, 2,...: 


(2n)! | » nn — 1) ,.-2 
P,(x) = ΤΙΣ |» ~ 2Qn — ἢ)" 
nin Δ Ὁ — Me — 3) oa _ | 7-48 


tT 9° 4Qn — DQn — 3) 


(a) Show that the first five Legendre polynomials, Po(x),..., Pa(x), are constant 
multiples of the polynomials listed in (7-45). (Recall that Oo! = 1. 


(b) Write each of the following polynomials as a linear combination of Legendre 
polynomials. 

(i) 3x? — 2x + 1 

(ii) —5x3 + 9x? — 3x — 2 (iii) 48x3 + 3x? — 3x + 2 
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Let W be a plane through the origin in 
6, and let x be an arbitrary point not 
on ‘WwW. Then, if y denotes the perpendic- 
ular projection of x onto W, the dis- 
tance from x to W is defined to be the 
length of the vector x — y, as shown in 
Fig. 7-11. Moreover, the vector y is 
characterized by the property that it 1s 
the unique vector in Ἂν such that x — y 
is perpendicular to W.* 

In this section we generalize these familiar concepts to arbitrary Euclidean 
spaces. To do so, however, it turns out that the subspace W must be restricted 
in some way in order to make things manageable. The most obvious and ele- 
mentary restriction is the requirement that Ὁ be finite dimensional, for then a 
vector d will be orthogonal to Ἂν if and only if d is orthogonal to each of the 
vectors in a basis for Ὃν (Exercise 12(b), Section 7-4). Thus, throughout the 
following discussion we shall assume that W is a finite dimensional subspace of Ὁ. 
Note, however, that we place no restriction on the dimension of Ὃ itself. 

Our first objective is to establish the existence of perpendicular projections, 
which we do by proving the following theorem. 


FIGURE 7=11 


Theorem 7-5. Let W be a finite dimensional subspace of a Euclidean space 
U, and let x be an arbitrary vector in 0. Then x can be decomposed in pre- 
cisely one way as 

x=ycd, (7-49) 


where y is a vector in ‘W, and ἃ is perpendicular to W. 


Proof. Since W is finite dimensional, we can apply Corollary 7-2 and find an 
orthonormal] basis e,,...,e, for W. Then if it exists at all, the vector y of 
Eq. (7-49) must be of the form 


Y = aye; + τ" + ann, (7-50) 


and it remains to show that the a; can be so determined that the vectord = x — y 
is orthogonal to each of the basis vectors e;.f But if we substitute (7-50) into 


* A vector x is said to be perpendicular or orthogonal to a subspace W of a Euclidean 
space if x is orthogonal to every vector in ‘W. 

7 Actually, we already know that this can be done, and that the answer is furnished 
by the (7 + 1)st step in the Gram-Schmidt orthogonalization process applied to the 
linearly independent vectors e1,..., €n, X. The argument which follows is a repetition 
of that step. 
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(7-49) to obtain 
X = aye; + +++ + ane, + d, 


and then apply the orthogonality condition 


d-e; = 0, Θ;" 6; = δι)» 


we find that 
αἱ = X'@y, .-., Qn = Χ’θ,. (7-51) 


This set of equations determines y uniquely in terms of x and the basis vectors 
€1,...,@n as 


y = (x-er)ey + °° + (K+ en den. (7-52) 


Finally, it is obvious that the vector ἃ = x — y is perpendicular to ‘W, and the 
proof is complete. ἢ 


We now show that the vector d, whichis called the component of x perpendicular 
to W, can be used to measure the distance from x to W. To do so, let z # ἃ be 
any vector in Ὃ such that x — z belongs 
to Ww. (One can view z as a vector from 
Ὁ to the point x; see Fig. 7-12.) Then 
since z — dcan be written as the differ- 
ence of two vectors in ‘W, it too belongs 
to W, and so is orthogonal tod. It now 
follows from the Pythagorean theorem 
that 


[212 = jal]? + lz — ἀ]} ", 7 FIGURE 7-12 


and hence, since ||z — d|| > 0, that ||z|| > [14}}. In other words, of all vectors z 
in © such that x — z belongs to W, ἃ is the one whose length is smallest. This 
serves to justify 


Definition 7-6. If W is a finite dimensional subspace of a Euclidean 
space U, and x is any vector in 0, then the distance from x to‘W is the length 
of the component of x perpendicular to W. 


In terms of this definition we can describe the perpendicular projection x — d 
of x onto W as that point in W which is “closest to” x, in the sense that if w is 
any other vector in W, then ||x — w|| is greater than ||d||. 

Before we apply these results to a number of interesting special cases, we remark 
that the use of an orthogonal basis for Ἃ in the above computations was merely 
a matter of convenience, not necessity. In general, if e;,...,e, 15 an arbitrary 
basis for W, and ἃ is the component of x perpendicular to W, then, because 
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x — d belongs to W, we can write 
x—d= aye; + ἐλ +t ann. 


This time the requirement that ἃ be orthogonal to each of the e; leads to the 
system of linear equations 


(€,°ey)ay + (61 θ2)α2 -  ᾿ + (61 Θρ)αη = €1°X, 
(62. 61), (62. 62)α2 -Ἐ ᾿ + (Co: On)an = €2°X, (7-53) 


(en + €1)a + (En " θ2)α2 Ἔ i (€, " Cn an = ὁ; ° X, 


in the unknowns a,,...,a,, Which must be solved in order to find d. Our earlier 
results guarantee that this system has a unique solution since we know that d is 
uniquely determined by x and ‘W. 

Digressing for a moment, we recall that a system of m linear equations in n 
unknowns has a unique solution if and only if the determinant of its coefficients 
is different from zero.* Hence 


61 "6. Θ᾽" 62 τον ΠΟ Ἢ 
πε es 2) (7-54) 
en + ey Cn * Co ane bie, 

This determinant is known as the Gram determinant of the vectors e,,..., en; 


and the above argument shows that the Gram determinant of n linearly inde- 
pendent vectors in a Euclidean space is always different from zero. The converse 
of this statement is also true, and furnishes a method for testing a (finite) set of 
vectors in a Euclidean space for linear dependence. We shall leave the proof of 
this fact to the reader, and let matters rest with a formal statement. 


Theorem 7-6. The vectors e\,...,€, in a Euclidean space are linearly 
independent if and only if their Gram determinant is different from zero. 


One final comment is in order before we consider specific examples. In practice 
it is usually easier to find d by solving the system of equations (7-53) instead of 
trying to use Formula (7-52). The reason for this is to be found in the fact that 
(7-52) applies only when e;,...,e, is an orthonormal basis for W, and the 
‘construction of such a basis is a tedious job at best. In essence, the issue here is 
that one ought to attack a simple problem directly, rather than try to adapt it to 
fit some general formula. Each of the following examples illustrates this point. 


* The student who is unfamiliar with determinants should omit this paragraph, and 
resume reading after the statement of Theorem 7-6. 
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EXAMPLE 1. The distance from a point 
to a line. Let x be any vector in a 
Euclidean space, and let £ be the /ine 
determined by the nonzero vector y; 
i.e., & is the one-dimensional subspace 
spanned by y (Fig. 7-13). We propose 
to find the distance ||d|| from x to £. 

Since y spans £, we can take y itself 9 
as a basis for £. This done, we must 
determine a so that the vector ἃ = x — ay is orthogonal to y. Thus 


fe 


y 


FIGURE 7-13 


0 =d-y = x-y — aly-y), 
and 


“| 
I< 


It follows that 

l|d|| = (ἀ - 4)" 
[(x -- ay): (x -- ay)] 
= [x-x — 2a(x-y) + ay-y)]”” 


Ν᾿ (x+y) , &-y) Gary", 
= |x-x ~ 2 yy boyy 


1/2 


and we have the formula 


; . νὴ) — (x-y)?|}/? 


for the distance from x to the line determined by the vector y ~ 0 in any Euclidean 


space. 
This formula assumes a particularly simple form in 6.2. For if x = (x1, X2) 


and y = (1, 2), then 
Ια] = _ + x5) + v2) - iyi + aya) : 
yit y2 
= ΕΞ -- 2x1Yexey1 + avi 
yi + yo 
~ [Gee = zu) | 
yit ye 


which may be written’ 
[4}} = Leia — νι. (7-56) 
Vy + y2 
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4 


For example, the distance from the 
point (—1, 1) to the line (through the 
origin) determined by the point (1, 1) 1s 


ja) = -Ξῖ τ ἢ ~ v3. 


(See Fig. 7-14.) 

In @? the formula for the distance 
from a point x = (X41, Xe, x3) to the FIGURE 7-14 
line determined by the nonzero vector 
Υ = (σι, ¥25 ¥3) is not nearly so simple as it isin R*. A straightforward calcula- 
tion starting from (7-55) yields 


[4} = eu =2 x2y1)” Ἔ ays -- ΧΑ) = (X2y3 __. zavay| (7-57) 
yityet γ 

A similar formula can be established for ®”, but it is obviously easier to use 

(7-55) directly. 


EXAMPLE 2. Find the distance from the point x = (1, 3, 2) in ®® to the plane 
(through the origin) determined by the vectors y; = (1,0,0) and y2 = (1, 1, 1). 
We must first determine a and β so that the vector 


ἃ = x — ay; — By2 
is orthogonal to y; and y». This leads to the pair of equations 
X*Y1 — a&¥1*y1) — Bly2-yi) = 0 
X*Yo — a(¥i* Yo) — BlY2°Yo) = 


Computing the values of the various inner products involved, we find that these 
equations become 

Ι-.ὰα- p=0 

6 -- α — 36 = 0, 


and hence a = —#, 8 = 3. It follows that d = (0, 4, —4), and 
1 
ja = fh Ἐ 4 = ¥2. 


EXAMPLE 3. The Fourier coefficients of f(x). Let C[—7, x] be the space of con- 
tinuous functions on the interval [—7, x] with the usual inner product 


= [ fg) ax, 


and let 3, be the (2n + 1)-dimensional subspace of Οἱ -- π, x] consisting of all 
trigonometric polynomials of degree < 2m + 1. (See Example 2, Section 7-3.) 
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We propose to compute the perpendicular projection onto 3, of any function 
fin C[—7, x]. 
By (7-34) this projection 15 of the form 


T(x) = > + ay cosx +--+: + a, cos nx 
+ δὶ snx - τ: - ὃ, sin nx, 
and we must determine values for the a; and b; so that 
d(x) = f(x) — Tx) 


is orthogonal to each of the functions 1, cos x, sin x,..., cos mx, sinnx. But, by 
(7-37), these functions are mutually orthogonal in C[—z, x], and so, by taking 
inner products, we have 


| fx) dx — 20 f dx = 0, 


f(x) cos x dx — ay / cos” x dx 


--τ 


I 
= 


f(x) sin x dx — b, | sin? x dx = 0, 


κ 


f(x) cos nx dx — a, | cos? nx dx = 0, 


-τ 


τ 


--ι 


f(x) sin nx dx -- ἯΙ sin? nx dx = 0. 


Since 2 
| dx = 2π, 


--τ 


and ie x 
2 
| sin? mx dx = / cos? mx dx = r 
--κ -τ 


if m > 0, it follows that : 
αὐ -- ἢ [0) 6», 
WSJ —x 


τ κ 


] ad 
αι τ -- 2 f(x) cos x dx, δι = a f(x) sin x dx, (7-58) 
a, = 1 f(x) cos nx dx, b, = 1 f(x) sin nx dx. 
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These coefficients are known as the Fourier coefficients of the function f. (The 
student should now appreciate the reason for associating the factor 3 with the 
constant term of the trigonometric polynomials in 3,. It was done simply to 
assure that each of the Fourier coefficients has the same constant before the 
integral, for without the 4 the formula for ag would have been (1/27) ae f(x) dx.) 

We have now shown that the trigonometric polynomial T whose coefficients are 
the Fourier coefficients of f is the best approximation in 3, to the function f, in 
the sense that of all the functions P belonging to 3,, T 1s the one which minimizes 
the integral 


[ΚΟ — POOP dx. (7-59) 


The value of this integral is often called the mean deviation (or mean square de- 
viation) of P from f. In these terms, T is that trigonometric polynomial in 3, 
with minimum mean deviation from Καὶ 

These considerations lead one naturally to the problem of determining whether 
the mean deviation of T from Κ᾽ tends to zero as nm — oo. In other words, can f 
be approximated arbitrarily closely by trigonometric polynomials? This and related 
topics will be investigated in the chapters which follow. 


EXERCISES 


1. Find the distance from each of the following points x in 612 to the line (through the 
origin) determined by the point y. 


(a) x = (1,0); y = (, 1) (b) x = (—2,1); y = @,1) 
(c)x = G Hs y = (—3,4) (d) x = (—2,10); y = (1,8 


2. Find the distance from each of the following points x in ®? to the line (through the 
Origin) determined by the point y. 
(a) x = (1,1,1); y = 1, 1, 0) (Ὁ) x = (01,1); y = C1, 1,90) 
(c) x = (2,1, —3); y = (—1,2,2) 
(d) x = (—3, 1, 3/V3); y = (4,3, 5V3) 
3. Find the distance from each of the following points x in 615 to the line (through the 
origin) determined by the point y. 
(a) x = ©, 2,1,1); y = (,3,1,3) (6b) x = (—1,3, 2,3); y = (1,1, 1,1) 
(c) x = (16, 3, 3,2); y = 4,3,2,1) dx = (0, —1,2,2); y = (-1,0, -2, 2) 
4. Let x and x’ be linearly independent vectors in ®? such that ||x|| = ||x’||. Show that 
there are two lines through (0, 0) for which the distances from x and x’ are equal, 
and that these lines are orthogonal. 
5. There are two lines through the origin in R? such that the distance from (1, 7) is 5. 
Find them. 


6. Find the locus of a point x in R? which is equidistant from each of two given distinct 
lines through the origin. 
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11. 


12. 
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. Find the distance from each of the following points x in ®® to the plane (through the 


origin) determined by the given points y and z. 

(a) x = (1,2,0); y = (—2,0, —2); z = Ci, 1, 6) 

(b) x = (2,—1,1); y = (4 —3, —1); z = (—1, 3, —2) 

(c) x = (1, —2,-1); y = (0,0, —V/21); z = (0, 2V/21, —5V21) 


. Let & be the line through (0, 0, 0) and (10, 2, 11) in 6ι5. Find the points on £ which 


are at a distance 3 from (2, —2, 1). 


. Find the coordinates of the point in 615 which lies on the plane determined by the 


origin, (1, 2, 2), and (2, —2, 1) and is at a minimum distance from the point (3, 1, 1). 
(a) Show that the area of the triangle in R? with vertices at (0, 0), (x1, x2), and 
(y1, 2) is ἔχιν — χων]. 

(Ὁ) More generally, show that the area of the triangle in &” with vertices at 0, x, and 
y is $[(x -x)(y-y) — (+ y)?])/”. 

Find the perpendicular projection of each of the following vectors in C[—7, 1] onto 
the indicated subspace W, and compute the distance from the vector to the subspace. 
(a) f(x) = x, W = 8(, cos x, sin x) 

(Ὁ) f(x) = cos? x, W = S(1, cos 2x) 

(c) f(x) = x2, W = S(1, cos x, cos 2x) 

Repeat Exercise 11 for the following vectors and subspaces of C[—7, z]. 

(a) f(x) = x7, W = SGin x, sin 2x) 

(Ὁ) f(x) = x3, W = S(1, cos x, cos 2x) 

(c) f(x) = x3, W = S(sin x, sin 2x) 


In Exercises 13-19 find the Fourier coefficients (for all values of m) for the given function 


in ΘΙ --π, 7}. 
13. f(x) = x 14. f(x) = x? 15. f(x) = sin? x 
16. f(x) = x", ma positive integer 17. f(x) = |x| 
18. f(x) = cos? x 19. f(x) = e* 
#20. Use the Gram determinant to test the following sets of vectors in ®? for linear 


21. 


22. 


independence. 

(a) ει = (2, —1,1), e2 = (4,2, 1), es = (—1, 2,0) 

(b) ει: = G4, 2, -- 1), e2 = (1,—-1,2), e3 = (—2,7,4) 

(c) ex = G,2,0), e2 = C9, --ἴ), 65. = 6, --ἰ ἃ 

Find the perpendicular projection of each of the following vectors in C[—1, 1] onto 
the subspace spanned by the polynomials 1, x, x? — 4, and compute the distance 
from these vectors to the subspace in question. 


(a) f(x) = x", nan integer (Ὁ) f(x) = sin x 

(c) f(x) = |x| (d) f(x) = 3x? 

Let e1,..., €, be an orthonormal basis in a Euclidean space VU, and let W be the 
m-dimensional subspace of U spanned by e1,...,@m, m “ ἢ. 


(a) Find the perpendicular projection of an arbitrary vector x in U onto W. 
(b) Find the component of x perpendicular to Ὅν. 
(c) Find the distance from x to ἍΝ. 


23. 


24. 


525. 


26. 


2]. 


28. 


Ἐ20͵ 
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Let %C be an arbitrary nonempty subset of a Euclidean space Ὃ, and let X+ (read 
“(Ὁ perp’’) denote the set of all vectors in U which are orthogonal to every vector in X. 
Show that 2+ is a subspace of U. What is X+ if αὐ = VU? If X contains only the 
zero vector? 

With X and X- as in Exercise 23, let (C+) denote the set of all vectors in U which 
are orthogonal to every vector in X+. 

(a) Show that X is a subset of (9C+)+, i.e., that every vector in X belongs to (9¢+)+. 
(b) Show that (9C+)+ = $(9) if Ὃ is finite dimensional. [Hint: Choose an ortho- 
normal basis for $(XC), and extend it to a basis for U.] 

(a) Let Ὃ consist of all infinite sequences 


s = {a0,@1,...,Qn,..-} 


of real numbers having only a finite number of nonzero entries, with addition and 
scalar multiplication defined termwise. If 


5 = Us ee aes 


and 
t= 460; big ics δι; ν), 


s°t = >> AnDn. 
n=0 


Show that with this definition U becomes an infinite dimensional inner product space. 
(Ὁ) Let ‘W be the subspace of U consisting of all sequences of the form 


define 


s = {a,a,0,0,...}, 


where a is an arbitrary real number. Show that w = (W-)-. 
Let U be a finite dimensional Euclidean space, and let W be a subspace of VU. Show 
that 

V=W+wt, 


and that W ™‘W+ contains only the zero vector (see Exercise 22, Section 1-4). 
Find Ὁ), where W is the subspace of 
618 spanned by the following vector or 
vectors. 

(a) (1, 1, 0) 

(b) (1, =I, 0), (0, 0, 1) 

(c) (1, 2, —1) 

(d) (1, 1, 1), (-1, -Ι, 5). 

Let II be an arbitrary plane and x an 
arbitrary vector. Show that the dis- 
tance from x to II is the perpendicu- 
lar projection of x onto Π-. (See 
Fig. 7-15.) 

Prove Theorem 7-6. FIGURE 7-15 
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*7-6 THE METHOD OF LEAST SQUARES 


One of the most important applications of the preceding material occurs in the 
theory of approximations. The problem here can be described most succinctly 
as the proper interpretation of experimental data, and a simple illustration is 
perhaps the best way of introducing the subject. 

Suppose that we wish to determine the value of a certain physical constant c, 
such as the specific gravity of a given substance, and that an experimental method 
for measuring c is available. We then perform the experiment 7 times and obtain 
estimates x;,...,X, Of c. In the absence of experimental errors each of the x; 
would equal c, but in practice, of course, none of them will, and we are thus faced 
with the problem of finding the “best approximation” to c available from our 
experimental data. 

To do so, we view the n experimental measurements as a vector x = (X1,... Xn) 
in ®”, and let y be the n-tuple (1,..., 1), so that 


ΕΥ̓ = (δι τοὺς. 


Then, if we interpret the term ‘“‘best approximation” as distance in &” (which, 
after all, is the most reasonable interpretation conceivable), and if we let c’ denote 
this approximation, we must choose c’ so that the vector c’y is as close as possible 
to x. In other words, c’ is determined by the requirement that c’y be the per- 
pendicular projection of x onto the one- 
dimensional subspace of ®” spanned by 
y (see Fig. 7-16). But, as we saw in the 
preceding section, this projection is 


so that 


~ yey n FIGURE 7-16 


This, of course, is none other than the arithmetic average of the x;, and we now 
have a theoretical interpretation of the popular practice of averaging separate 
(independent) measurements of the same quantity. 

Appropriately generalized, the foregoing method will yield approximations to 
vectors as well as scalars. For simplicity we consider the case of a vector ς = 
(ci, Co) in ®”, and a set of measurements 


X1 = (%11, X19), 
(X21, X22), 


Χο 


Xn = (Xn1, Xn2) 
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of c. Again we wish to use the x; to obtain the best possible approximation c’ = 
(εἰ, cg) to ς. 
This time we view the experimental results as a vector 


X = (X11, X91,--+ 5 Χμ1» X12) +++ 5 Xn2) 
in 2”, and let y, and y>2 be, respectively, the orthogonal vectors 


(1,...,1,0,...,0) and (0,...,0,1,...,1) 
n n n n 


in 612". Proceeding as before, we take as our approximation the scalars cj, οὗ 
such that cly; + coY2 is the perpendicular projection of x onto the subspace 
S(y1, Y2). Thus the vector x — (cjy; + coy2) must be perpendicular to y, 
and yo, whence 


f= and εἰ, = >”. 
y1°Yi1 Y2°Ye2 
This gives 
»-. X11 + χα bee t+ Xn , _ X12 + X22 t+ + Xne 
= c¢ = --Ξ--“--.-.ς.ς-.ς- “-““, 
n n 
and 
Ι 
cf = x + τ: Xp). (7-60) 


This vector may be familiar to some of our readers as the centroid of the vectors 
X1,...,Xn- We note that it may be characterized as the vector in ®? which 
minimizes the quantity | 


n 
>, [χε — elf? (7-61) 
i=1 
(see Exercise 4 below). . 
In general, n experimental determinations x,,..., x, of a vector c in ®” can 


be handled in exactly the same way, and it is not difficult to show that Formulas 
(7-60) and (7-61) continue to describe the best approximation. 

A related problem of this type occurs when one is given a scalar y which is 
known to depend linearly upon a scalar x, i.e., 


Y= Cx, 


and one attempts to determine the value of c experimentally. (For instance, y 
might be the displacement of a spring under a weight x, in which case c would be 
the spring constant.) In this case our experiments yield a set of measured values 
X1,...,5X, Of x and corresponding values y;,...,¥n for y, which can be dis- 
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played as a system of n linear equations 


Yi = CX; 
Yo = CX, (7-62) 
Yn = CXny 


in the single unknown c. As a result of experimental errors, this system of equa- 
tions will not be compatible (i.e., will not admit a unique solution), and our prob- 
lem is to find the “best approximation” to c afforded by this data. 

Again we pass to Euclidean n-space, ®”, and consider the vectors 


xX = (%1,..., Xn) and Υ = (1,---5n)- 


In this context our problem can be rephrased as follows: Find a scalar c’ such that 
the vector c’x in the subspace S(x) is as close as possible to y. This, of course, 
requires that c’ be so chosen that the vector c’x — y has the smallest possible 
Jength. Thus c’ must minimize the quantity ||c’x — y||’. But 


(c’x — y): (cx — y) 


> (c’x; =o yi)’, 
t==1 


lex — γ]} 


and we see that the best approximation to c is the scalar which minimizes the sum 
nr 
>, (ex: — yi)’. (7-63) 
i=1 


For rather obvious reasons this method of approximation (and its generalization 
below) is called the method of least squares. 

In the present example it is easy to compute the value of c’ explicitly. Indeed, 
since c’x — y must be perpendicular to x we have (c’x — y)-x = 0, and hence 


Or 
ΑΒ x1 pe wake ; (7-64) 
xy Ἢ Xa 


EXAMPLE 1, Use the method of least squares to find the best approximation to c 
available from the equations 
— (, 
= 36, 
4c, 
= 6c. 


nnn ON 
| 
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Here x = (1, 3, 4,6) and y = (2, 2, 5, 6), so that 


, 246420436 32. 
ς ΠΤ 16-.36 351] 


The type of approximation which has just been considered often arises as a 
problem in curve fitting. In this context one is asked to find a straight line y = c’x 
through the origin (in ®”) which best fits the points (x1, y1),..-, (Xn) Yn). The 
accepted method of solution is to let A; denote the difference c’x; — y;, as shown 
in Fig. 7-17, and then choose c’ so that the sum of the squares of the A; is a mini- 
mum.* But this sum is just the quantity given in (7-63), and the present problem 
is identical with the one solved above. 

Finally, we consider the general situation in which a scalar y is an unknown 
linear combination of the scalars x;,..., Xm} 1.6., 


Y= CyXy $e H+ Cm Xm. 


Again we imagine that n experiments have been performed (where n > m), and 
that the ith experiment has yielded the values x;1,..., Xim, and γι, respectively, 


for X1,...,Xm and y. Thus we have a system of linear equations 
Yiu = CyX11 + CoX12 Γ΄ + CmX1im, y 
/ 
Yo = CyXe1 + ΟοΧ2 + °° °° + CmXam, 
Yn = CiXn1 + CoXn2 ΞΡ ΕΓ CN 
(7-65) 


in which the c; are unknowns. In general, of 
course, (7-65) cannot be solved, and our 
problem becomes that of finding values 
Οἵ, ον φῇ, for the c; which make the ex- 
pressions standing on the right of these equa- 


i 


(x1,¥1) 


tions approximate y ;,..., ny, as Closely as FIGURE 7-17 
possible. 
By now the method should be obvious. We consider the vectors 

ΧΙ = (X14, X21,---5 Xn), 

Χο = (X12, X22,--- 5 Xna); 

Xm = (Χ 1)» Χ Δ ηλ9» . 19 Xin); 
and 

y= (λον Ὁ») 


* It makes excellent sense to use the quantities A? for this purpose rather than the A; 
themselves, since in the latter case a large positive difference would obliterate the effect 
of several small negative differences, contrary to the requirement that each point be 
given equal weight in the fitting process. 
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formed from the columns of (7-65), and let W be the subspace of ®” spanned by 
X1,...,Xm (recall that m <n). We now make the assumption that our ex- 
periments were so designed that x},..., X» are linearly independent, so that they 
form a basis for W. The cj,..., Cm are then chosen so that the vector 


ΕἸΧῚ ΞΡ ΞΌΞΕ CmXm 


is the perpendicular projection of y onto W. Thus the c; must minimize the 
length of the vector 


(οχ, +++ + CnXm) — Y; 


or, equivalently, they must minimize the quantity 
> (cheer +++ οἰκία) — γῆ, (7-66) 
i=1 


which is the square of the length of this vector. 
In practice the c; are usually determined from the orthogonality relations 


[(chxy τ + οὐχ) — y]- x: = 9, 


i = 1,...,m. They yield the system of m linear equations 


(xp xy)cd + (Ki Xa)co +e Ὁ Kis Xm)em = X1°Y, 
(Χο - Χι)εῖ + (X2°Xe)co +++ + (Ka+Xm)em = X2°y, 
(Xm *X1)C1 + (Xm+ X2)C2 + τ: + Kms Xm)Cm = Xm, 

in the m unknowns cj,..., Cm, which, in slightly different notation, has already 


been discussed in the preceding section [see (7—53)]. These equations are called 
the normal equations for the approximation in question. 


EXAMPLE 2. Let y = ¢1X1 + CoX2, and suppose that as a result of four separate 
experimental determinations we have found the set of equations 


15 = c, + 2€g, 
12 = 2c, + Co, 
10 = Ci τς C25 


0 = ει — Co. 


Use the method of least squares to find the best approximation to c, and Cg. 
In this case, m = 2,n = 4, and 


x; = (1, 2, 1, 1), ¥o = QQ) 171), y = (15, 12, 10, 0). 
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(Note that x, and xz are linearly independent in @*, as required.) Thus the normal 
equations for this approximation are 


Tce, + 4; = 49, 
4c, + 7c = 52, 
and ci = #2, cp = 28. These then are the experimentally determined values of 


Cc, and co, and we have 
lly = 45x1 + 56X 9. 


EXAMPLE 3. Find the equation of the parabola in the xy-plane which passes 
through the origin of coordinates and has vertical axis, and which best fits the 
points (—1, 3), (1, 1), (2, 5) in the sense of the method of least squares. 

The general equation of such a parabola is 


» = 1x7? + Cox, 
and the above data give the set of equations 


= οι — Ca, 
l Ci = Ca, 
5 Aci + 2Co. 


Thus the least square approximation to c, and 62 is obtained by solving the 
normal equations for the vectors 


x, = (Ι, Ι, 4), Χο = (=I; I, 2), J= (3, I, 5). 


These equations are 


18c, + 8c4 = 24, 
δεῖ + 6c = 8, 
and their solution is c; = 39, οὐ = —42. Hence the desired parabola is lly = 


20x? — 12x, and as can be seen in Fig. 7-18, this curve really does fit the given 
points extremely well. y 


lly =20x?—12x 


(2,5) 


FIGURE 7-18 
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EXERCISES 


1. When an experimental approximation is made by replacing a vector x in an n- 
dimensional Euclidean space Ὃ by its perpendicular projection x’ on a subspace of 
© the quantity ||x — x’||?/n is called the variance of the approximation. The mag- 
nitude of the variance of the approximation is taken as a measure of the consistency 
of the data used in obtaining it, and in judging between two experimental approxi- 
mations the one which has the smaller variance is taken to be the more consistent. 

Suppose two students perform a series of five experiments to determine the valuc 
of a physical constant with the following results: 


Student A: 1.402 1.420 1.395 1.418 1.406 
Student B: 1.416 1.405 1.419 1.422 1.406 


(a) Find the best approximation to the constant which can be made by each student. 
(b) Which set of values is the more consistent? 

2. Let (x1, ..., Xm) be the vector whose components represent the results of a series of 
m experimental determinations of a physical constant, and let (%m+1,... 5 Xm-+4n) 
represent the results of n experimental determinations of the same constant. Show 
that the variances for the two separate series of experiments do not each exceed 
the variance for the single series of experiments (x1,...,Xm4n). Under what 
conditions will equality hold? 


3. (a) Repeat Exercise 1 for the following two series of measurements: 


Student A: 16.02 15.99 16.12 1607 16.10 
Student B: 16.11 16.16 16.07 16.12 16.14 


(b) Consider the sequence obtained by combining the two sets of data in (a). Find 
the best approximation for this sequence, and compare its variance with the vari- 
ances for the two approximations in (a). 

4. Prove that the assertion made in the text concerning expression (7-61) is true. 

5. The center of population of a geographical region is by definition the centroid of the 
residences of its inhabitants. Suppose that the population of a certain region is 
concentrated in four cities, with a negligible number of residents elsewhere, and 
suppose that the population and position (with respect to a Cartesian coordinate sys- 
tem in the plane) of each is as follows: 


City A: 1,000,000 at (0, 0) City B: 600,000 at (10, 5) 
City C: 300,000 at 5, 10) City D: 100,000 at (0, —20) 
Find the center of population. 
6. Repeat Exercise 5 for the following data: 
City A: 2,000,000 at (0, 0) City B: 500,000 at (6, 18) 
City C: 300,000 at (—3, 15) City D: 200,000 at (0, -- 12) 
7. The center of mass, or center of gravity, of a system of k particles, each of mass m; 


located at the point x;, i = 1,2,...k, in ®” is defined to be the centroid of the k 
vectors m;x;. Find the center of mass of each of the following systems in 6.5. 
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(a) my = 2, x1 = (1, 3,0) (Ὁ) m; = 1, x1 = (1,5, 0) 
m2 >= 3) x2 = (=2, 4, 1) ma = 1, x2 = (2, 3; 3) 
m3 = 1, x3 = (0,6,2 m3 = 3, x3 = (7,0, 1) 
m4 = 4, x4 = (—1, =); 3) m4 = 5, Χά = (2, =—3; 6) 

(c) mi = 5, x1 = (3, 1, 532) 
m2 = 1, x2 = (4, 0, 1) 
m3 >= 4, x3 >= (0, 0, 0) 
m4 = 3, x4 = (2,2,1) 
m5 = 5, X5 = (1, 1, 2) 
me = 2, x6 = (4, 1, 6) 


8. Repeat Exercise 7 for the following data: 


10. 


11. 


12. 


13. 


14. 


(a) my, = 1, ΧΙ = (1, Zi —~3) 
m2 = 2, x2 = (3, —4, 5) 
m3 = 3, x3 = (—1, 0,0) 


(b) m, = 1, x1 = (7, —5, 2) (c) my = 2, x1 = (2,3, =1) 
m2 = 2, x2 = (6, 3; 1) m2 = 5, x2 = (4, =2, 1) 
m3 = 5, x3 =  (-ἴ, —1, 2) m3 = 4, x3 = (6, —3, 2) 
m4 = 8, x4 = (2,2,0) m4 = 3, x4 = (-1, —1, 0) 
ms = 4, x5 = (3,5, —1) ms = 6, x5 = (0,0, 0) 
me = 5, x6 = (7,1, 0) 
. (a) Show that the center of mass x (Exercise 7) of k particles, each of mass m; located 
at the point x,,i = 1, 2,..., k, minimizes the quantity ||Mx — >-*_, mx;||?, 


where M = yi mj. 

(b) Let x1 = (0,0,0), x2 = (1, —1, 3),x3 = (1, 1,5), x4 = (2, —8, —10). Find 
a set of masses m1, m2, m3, m4 such that [10χ — Σ ἢ 1 m,x;||? is minimized by the 
vector x = (1, —1, 2). 

Let m, = 4, x1 = (0,0,0); me = 3, xe = (1,1,1); m3 = 2, x3 = (1,1,0); 
m4 = 1. Determine x4 so that |/10x — Σ ᾧ 1 m;x;||? is minimized by x = (1, 2, 1). 
(See Exercise 9(a).) 

Let T be a linear transformation mapping ®” into itself, and let x be the centroid of k 
vectors X1,...,X, in ®”. Show that 7(x) is the centroid of the vectors T(x), 
so 08% T(xx). 

Let T be the transformation which maps each vector in a Euclidean space Ὃ onto its 
best approximation (in the sense of least squares) in a given finite dimensional sub- 
space of U. Prove that Τ' is a linear transformation. What are the null space and 
image of T? 

Find the line y = cx in ®? which best fits each of the following sets of points. 
Sketch the graph of each of these lines, and plot the given points relative to the 
standard coordinate system in 612. 

(a) (5, 9), (10, 21), (15, 19) (Ὁ) (—4, —11), (4, 3), 6, 16), (10, 29) 

(c) (—6, 10), (2, —2), (δ, -- 11), (10, —16) 

Repeat Exercise 13 using the following data. 

(a) (—4, 9), (4, —10), (12, —25) (Ὁ) (—5, —16), (10, 31), (15, 31), (20, 40) 
(c) (—4, —5), (8, 9), (12, 16), (20, 24) 
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In Exercises 15-18 suppose that y = c1x1 + c2Xx2, and use the method of least squares to 
obtain an approximate formula for y from the given data. 


15. ΧχιιΞ- 1, x12=0, yr =2 16.x11=1, xi2=0, yi =1 
x21 = 0, xe2 = 1, y2 = 3 x21 = 0, xe2=1, yo=l 
x31 = 1, x32 = 1, y3 = 2 x31 = —l, x32 = Q, y3 = 3 
x41 = 1, x42 = —1, ys = 0 

17. X11 = 10, X12 = 10, y1= 0 
x21 = 10, xe2 = —10, yo = 19 
x31 = —10, x32 = 10, y3 = —2l 
X41 = —10, x42 = —10, ys = 0 

18.x11 = 3, x12=4 yi =O 
x21 = 7, xe2 = 1, y2 = 10 
x31 = 1, x32 = 1, y3 = —5 
x41 = 4, x42 = 3, ys = 0 


19. Find the best approximation to the formula y = cix1 + cexe + c3x3 from the 
following data: 


x11 = Ὁ, x12 = 0, x13 =0, yi =1 
χοι Ξ- 1, xe2=1, x23 = --ἴ, yo =2 
x31 =1, »x32 = —-1, x33 =1, y3 = —1 
x4, = 0, χα = 1, χα9 = 1, ys = -2 


20. Find the parabola through the origin in R? with vertical axis which, in the sense of 
least squares, best fits each of the following sets of points. Sketch the graph of each 
parabola and plot the points it approximates. 


(a) (1, 2), (2, 5), (3, 9) (b) (—1, —1), (4, 9), G, —5) 
(c) (—1, 4), (4, 2), ὦ, 10) 

21. Repeat Exercise 20 for the following sets of points. 
(a) (1, 4), (2,5), (-1, —3) (Ὁ) (1, 3), (2,7), (—1, 2), (-- 2, 8) 
(c) d, —1), (2, —3), (—2, 1) 

22. Find a cubic curve through the origin in ®? which, in the sense of least squares, best 
fits each of the following sets of points. Sketch the graph of each curve obtained and 
plot the approximating points. 


(a) (1, —2), (-1,1), (2, —5), 3, —20) Ο) 1, 2), (-1, 0), (4, 7), (--2, -- 4) 
23. Find the fourth-degree equation in the form 


y = ax*t + bx? + cx 
which, in the sense of least squares, best fits the following points in R?2: 


(—2, 2), (—1, 1), (i, 2), (2, 1). 


*7-7 AN APPLICATION TO LINEAR DIFFERENTIAL EQUATIONS 


In Chapter 4 we learned how to obtain n distinct solutions of any nth-order 
homogeneous linear differential equation with constant coefficients from the roots 
of the auxiliary polynomial. At that time we also indicated how operator tech- 
niques could be used to prove the linear independence of these solutions in the 


7-7 | AN APPLICATION TO LINEAR DIFFERENTIAL EQUATIONS 299 


real vector space C(/), where J is an arbitrary finite or infinite interval. We re- 
frained from doing so, however, because such a proof 1s both tedious and unin- 
teresting. But now that we have the notion of an inner product available, we 
shall give a particularly elegant proof of this result which has the added virtue of 
serving as an excellent example of the interplay between analysis and the theory 
of Euclidean spaces. 

Specifically, we must prove that every set of functions of the form 


x™e** sin bx and xe cos bx, (7-67) 


where a and b are real numbers (6 > 0) and m is a non-negative integer, is linearly 
independent in the real vector space C(— 0, οο). To this end suppose that F 
is a (finite) linear combination of such functions, and that F(x) = 0. We must 
show that all of the coefficients in F are zero. 

Our first step consists of rewriting F by grouping together those terms which 
contain the same exponential factor so that 


F(x) = e®"Py(x) + e°*Po(x) + τ. + e°"P,(x), (7-68) 


where ay > ag > ++: > a, > Ὁ, and each P,(x) is a linear combination of 
functions of the form x” sin bx and x”cos bx. Next we rewrite each P,(x) by 
grouping together those terms which contain the same power of x. This gives 


P(x) = Tio(x) + Tir(x)x + +++ + Tig (x)x", (7-69) 


in which the coefficients 7;; are expressions of the form 


T;;(x) = > (a, COS a,x + Bz sin b;x), (7-70) 


k=1 


where the a;, 6, are real numbers and the ἀρ, b; are non-negative real numbers. 
In what follows we shall refer to expressions of this form as trigonometric sums, 
and we note that every such sum may be written as 


or + d, (a, COS a,x + βᾳ sin b,x) 


with az, δὲ positive. 
The essential step in proving that all of the coefficients of F are zero is fur- 
nished by the following lemma. 


Lemma 7-2. /f T is a trigonometric sum with the property that πὶ, ὦ T(x) = 
0, then all of the coefficients of T are zero. 


* Note that it is sufficient to consider linear independence in C(—, ©) since by 
Theorem 3-2 (the uniqueness theorem) such a set of solutions is linearly independent 
in C(—, ©) if and only if it is linearly independent in C(J) for every subinterval J of 
(— 0,0). (See Exercise 22, Section 4-3). 
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Proof. Let 3 be the real vector space consisting of all trigonometric sums, with 
the usual definitions of addition and scalar multiplication, and define an inner 
product on 3 by 


fog = sim! | feta) dv (7-11) 


for any pair of trigonometric sums f and g. It is easy to see that (7-71) does in 
fact define an inner product on 3 provided that the limit in question always exists 
(see Exercise 1). To prove the existence of this limit we first observe that since 
integration is a linear operation (i.e., is performed term by term) it suffices to 
consider the case in which f and g are “monomials.” In other words, we need 
only establish the existence of (7-71) when 


Case 1. f(x) = cosa,x, g(X) = COSQ2x, αι. 9 = 0; 
Case 2. f(x) = cosa,x, g(x) = sinbyx, a, => 0, δι > 0; 
Case 3. f(x) = sinbyx, g(x) = sinbex, b;,b2 > 0. 
Suppressing most of the details, we obtain the following results. 


Case 1. 


. Ljsin(ay — ag)t , sin(a, + ax _ : 
am ᾿ αι — ae αι + ae εὐ πὲ αἱ. 
Ν I sin2a;t} 1. af 
f-g= im 2}... 5526). 5 if ay = ag ~ 0, 


t 
tim + { dt= 1, if a, = ag = 0. 
[0 


t—0 
Case 2. 
. 1) cos (1 — a,)t COs (δι + αι) l l |- 0 
{πὶ} - ῥ᾽ -- G1 b, + ay, area sey 
f: 5 = if Ω1 _ bi, 
jim | at = 0, if a, = δι 
t—00 2t ay 
Case 3. 
sin(b; — δ) _ sin (δι + ad τοῖς ἢ 
τ ΝΣ ee 
8 - 1 io ι΄. 
fim 5; σι — 2b; sin 2b,t| = 5° if by = bo. 


Hence the necessary limits exist, and (7-71) defines an inner product on 3. More- 
over, from the above computations we see that whenever a and ὁ are positive real 
numbers the functions 

1, cosax, sin bx 
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are orthogonal in 3, and 


Ϊ , ] 
1|} = 1, cos ax|| = —=> sin bx|| = —=: (7-72) 
[1 | | We Ι | wo 
Now suppose that : 
T(x) = I + 2d, (ax, COS Ax + Bx sin b,x) 


is a trigonometric sum such that 


lim T(x) = 0. 


pe 0° 8) 


Making use of the orthogonality just established, together with the relations listed 
in (7-72), we have 


t 


_ T(x): cosax 4, 1 = 
a, = ΠΤ Γἢ ae 2 tm , T(x) cos a,x dx, k = 0, l, , ἢ, 
é 
_ T(x): sindbyx ,Ἅ.,.. 1 = 
8. = =qsieBpsl2 2 lim zie T(x) sin διχ dx, k = 1, 2,..., ἢ, 


and to prove the lemma we must show that all of these coefficients are zero. 
Let us examine the a;. By assumption, T(x) — 0 as x — o. Hence, given any 
real number e > O, there exists a real number r > Ὁ such that 


IT(x)| < € whenever x > vr. 


Then 
Ι t 
lo,| = | lim ᾿ | T(x) cos a,x dx 
[0 0 
if" {, 
= lim Ὶ | T(x) cos a,x dx + ri | T(x) cos a,x dx 
t— 00 0 r 
oe ae 
< lim Fi | | T(x) cos a,x dx} + lim 5 | / T(x) cos ax dx] - 
t— 0 0 t— 0 r 
But 
oe ce a 
lim Ἴ | T(x) cos a,x dx} = 0, 
t—00 0 
while 
Ι t t 
lim Ἴ / T(x) cos a,x dx| < lim , | |T(x) cos azx]| dx 
£2508 r tool Jr 


t 
< lim 1 € dx 
f—00 r 
— lim e(t — r) = 


ta t 


ξ. 
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Hence |a;| < ¢ for any positive number e, and it follows that a, = 0. A similar 
argument shows that 6, = Ὁ for all k, and the proposition is proved. J 


It is now relatively easy to establish our main result, which we state formally as 


Theorem 7-7. The set of all functions of the form (7-67) is linearly inde- 
pendent in C(— oo, οὐ). 


Proof. Let F be a finite linear combination of these functions such that F(x) = 0. 
We rewrite F in the manner described above as 


F(x) = e* P(x) - --: + &P,(x), (7-73) 
where a; > @g > °°: > a,, and 
P(x) = Tio(x) + --- + Tis (x)x". (7-74) 


We shall assume that F has at least one nonzero coefficient, and deduce a 
contradiction. 

Indeed, if such is the case there exists at least one integer 7 such that P; has 
a nonzero coefficient. With i chosen as small as possible, we have 


F(x) = e*Pi(x) + cP: i(x) + <*> + e%P,(x), 


and hence 
Px) = ε΄ ΕΛ — 1" (x) — -τ- — er 2P*P, (x). 
Since F(x) = 0, 


lim e °" F(x) = 


and since 
(a;—a,;)x — 
lim e°F—"'" P(x) = 
re 


whenever j > i, it follows that 


lim P(x) = 0. 
But P; has at least one nonzero coefficient. Hence there exists at least one 
index j in (7-74) such that the trigonometric sum T;; has a nonzero coefficient. If 
we choose 7 as large as possible, then 


P(x) = Til) + τ: + Tix’, 
whence 


ΠΣ Τιο(χ) Τιι(χ) Τ᾽ J— 1(x) 


— sees --....-- -ἰ----.- 


T(x) = 


7-7 | AN APPLICATION TO LINEAR DIFFERENTIAL EQUATIONS 303 


Since it is clear that each of the terms on the right-hand side of this equation tends 
to zero aS x — oo, we conclude that 


lim 7;;(x) = 0. 


This, however, contradicts Lemma 7-2 since T;; has nonzero coefficients. It 
follows that all of the coefficients of F must be zero, and the theorem 15 proved. J 


EXERCISES 


1. Verify that (7-71) defines an inner product on the vector space 3 of all trigonometric 
sums. In particular, if 


f(x) = ΤΙ + Ds (a, COS a,x + βιὰ sin b,x), 
k=1 


show that 


2. Suppose that the roots of the auxiliary polynomial for a constant coefficient linear 
differential equation are 2, 2,2 + 2i,2 + 21,2 + 31,2 + 31,24 3,1 tijlri. | 
Write out F as in the text, and group the terms in the way described. 

3.. (a) In the proof of Theorem 7-7 we asserted that 

lim e'*i—*?*P.(x) = 0 


re 


whenever j > i. Prove the assertion. 
(b) Prove that 


lim T(x) = 


nr 
tom Χ 


0 


whenever 7 is a trigonometric sum and n is a positive integer. 


ὃ 


convergence in euclidean spaces* 


8-1 SEQUENTIAL CONVERGENCE 


In this chapter we prepare the way for the study of such topics as Fourier series 
and boundary value problems by introducing the notion of convergence in Eu- 
clidean spaces. As we shall see, the really interesting applications of this concept 
occur in infinite dimensional spaces, but for the sake of completeness the basic 
definition will be given without reference to the dimension of the underlying space. 


Definition 8-1. A sequence {Χμ} = {x1, X2,...} of vectors in a Euclidean 
space Ὃ is said to converge to the vector x in Ὃ if and only if 


lim |x, — xl] = 0. (8-1) 


In this case x is said to be the Jimit of {x;}, and we denote the fact that the 
sequence {Χμ} converges to x by writing 


lim {Χμ} = x. 
k—0 


We recall that the above definition is an abbreviation for the statement: {x;} 
converges to x if and only if for each real number € > 0, an integer K can be found 
such that 

xz — xl] <€ (8-2) 


for allk > K. In general, of course, the integer K depends upon e, and increases 
as € approaches 0. Moreover, since the quantity ||x;, — x|| is just the distance 
from x; to x, (8-2) asserts that {x;} converges to x if and only if the distance from 
x; to x approaches 0 as k becomes large. And this is precisely what intuition 
demands of sequential convergence. 


* Although this chapter is logically self-contained, we assume that the reader is familiar 
with the notions of sequential convergence and infinite series as studied in elementary 
calculus. A review of this material can be found in Appendix I. 
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Before Definition 8-1 can be accepted as a reasonable description of convergence 
we must prove that the limit of a convergent sequence of vectors is unique, in the © 
sense that a given sequence can never converge to more than one vector. This 
we do by establishing 


Lemma 8-1. Jf 
lim {x,} = x and lim {Xi} = y, 
k—>00 — 0 

then x = y. 


Proof. Let € > 0 be given. Then, by definition, there exists an integer K such 
that 


|x, -- χ << €/2 and |lxz — y|| < €/2 
whenever k > K. Thus, by the triangle inequality, 


IIx — yll < [x — xel] + χε — y| 


Since € > O was arbitrary, this inequality implies that |x — y|| = 0. Hence 
x = y, as asserted. J 


EXAMPLE 1. Let {a,} be a sequence of real numbers, viewed as vectors in δι᾽. 
Then {a;,} converges to the real number (i.e., vector) a if and only if 


lim |la, — αἰ] = 0. 
k—0 


Recalling that the inner product in σ᾽ is just ordinary multiplication of real 
numbers, we find that 


[ας — αἱ = [(az — α)" (a — ay"? 
= [ (ax a a)?}'!? 
= |a, — al. 


Hence {a;,} converges to a if and only if 
lim [ακ = al =); 
ko 
But this equation is none other than the definition of sequential convergence given 


in elementary calculus, and it therefore follows that sequential convergence in @* 
is identical with the usual convergence of sequences of real numbers. 
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EXAMPLE 2. Let e1,...,¢, be an orthonormal basis in ®”, and let {x,} be a 
sequence of vectors in ®”. Then if 


xX = a e1 + eee + Anen 
. ® . ὦ X5 Χο ΧΙ 
is an arbitrary vector in @”, ἀπά if, foreach ὁ ὃ |y--7—----—----- 
integer k, 
Xe = ypey + °°* + angen, 
we have 
2 2 
[xz — xl]° = (αι — αι) 


sda (Qnk of On)”. ΘΙ 


Hence 


lim ||x, — x|| = 0 
k-0 
if and only if the sequences 


{ar} πῆ ἴα 11; ΑἹ2: « - ΕΣ 


{aon} — {a21, 22, +s εἶς 


fanz} = {an1, ἀμ, - - «ἢ, FIGURE 8-1 


converge (as ordinary sequences of real numbers) to a1,..., on, respectively. 
For instance, if e; and 6.9 are the standard basis vectors in ®”, then 


αὐ = μενοι + (ey 


1 
= {e, + eo, ξδι — eo, ζ681 + e2,...} 


does not converge because the sequence {1, —1,1,...} formed from the com- 
ponents of eg is not a convergent sequence of real numbers (see Fig. 8-1). On 
the other hand, the sequence 


{(1/2*—")e1 + eo} 


converges to the vector 6.5, since {1, 4, ,...} converges to 0, and {1,1,1,...} 
converges to 1 (Fig. 8-2). 


The preceding examples show that the study of convergence in finite dimensional 
Euclidean spaces is essentially the same as the study of convergence of sequences 
of real numbers. However, in infinite dimensional spaces such as Cf[a, δ] the situa- 
tion becomes much more complex, and correspondingly more interesting. For 
then the type of convergence defined above is radically different from that studied 
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in calculus under the name of pointwise convergence.* Indeed, we shall see 
momentarily that in a function space with an integral inner product the assertion 
that 


lim If, — ἢ] = lim ( [ Ef) — FOO? dx)? = 0 


is not at all the same as saying that the sequence {f;,} converges to the function f 
at every point of [a, b]. In analysis such convergence is known as mean convergence 
to emphasize that it is computed by integration, which, 1n a sense, 1s a generalized 
averaging process. 


FIGURE 8-2 


EXAMPLE 3. The sequence of functions {x, x”, x°,...} converges in the mean 
in C[—1, 1] to the zero function since 


1 1/2 
lim ||x* — O|| = lim ([ πῶ dx) 
k0 k—a0 —1 


ie 
ἊΝ € Ξε 7 


= 0. 


This not withstanding, {x, x”, x°,...} does not converge to zero at each point in 
the interval [—1,1]. In fact, at x = 1 the sequence converges to 1, while at 
x = —1 it does not converge at all. (See Fig. 8-3.) 


The example just given shows that mean convergence is different from pointwise 
convergence. The one which follows shows how different it really is. 


EXAMPLE 4. Let Φό[α, δ] denote the set of all piecewise continuous functions on 
[a, δ]: that is, the set of all functions which are continuous everywhere on [a, ὁ] 
except (possibly) at a finite number of points where they have jump discontinuities 
(see Section 5-1). In Section 9-2 we will prove that @C[a, δ] can be regarded as 
a Euclidean space under the usual definitions of addition, scalar multiplication, 


* Recall that a sequence of functions {f,} defined on [a, ὁ] is said to converge pointwise 
to the function f if lim,. f,(x) = f(x) for each point x in [a, b]. (See Appendix I.) 


308 CONVERGENCE IN EUCLIDEAN SPACES CHAP. 8 


4 


—1 


FIGURE 8-3 


and inner product, the last being defined by the formula 


b 
f-g = i f(x)g(x) dx. 


Accepting the truth of this assertion, let [a, b] be the unit interval [0, 1], and let 
I,, Ig, ... be the sequence of subintervals 


i = [0, 1], 
1. = [0, 31, 73 ὮΣ [2, 1], 
Is ἊΣ [0, al, Is = a; 3 3 


Ig = [3; #1, I; τὰς [i I], 


FIGURE 8-4 


(See Fig. 8-4.) For each integer k > 0, let f(x) be the function in ΦΟΙΟ, 1] 
which has the value 1 when x is in Jj, and 0 elsewhere on [0, 1] (Fig. 8-5), and 
consider the sequence {f;,}. (The function f;, is known as the characteristic function 
of the interval J;,.) We assert that {f,} converges in the mean in @C[0, 1] to the zero 
function, but does not converge pointwise anywhere in [0, 1]. 

To prove mean convergence we must show that 


lim Πα — Ol] = 0. 
But 
fe -- Ol = (ff ECO? dx), 
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FIGURE 8-5 


and since f; is identically 1 on J, and is zero elsewhere, the value of this integral is 
just the square root of the length of 15. However, the length of J, tends to zero 
with increasing k, and it follows that 


tim (f Lfa(@)I? dx)"? = 0, 


as asserted. 

Now let x9 be a fixed point in [0, 1], and consider the sequence of real numbers 
{ fi(X0)}. We contend that this sequence does not converge. For, by definition, 
fx(Xo) is either 1 or 0 depending on whether xq is or is not in 15. But the J; were 
constructed in such a way that there exist arbitrarily large values of k for which 
Fix(Xo) = 0 and arbitrarily large values of k for which f,(xo) = 1. Thus {f,(xo)} 
contains both zeros and ones no matter how far out in the sequence we go, and 
hence does not converge. 


EXERCISES 


Determine which of the following sequences {a;} converge in 6}, and find the limit of 
each convergent sequence. 


_ (-1) Saget 
1. a, = i 2. ak = Eq 
k k? 
3. a, = 1+ (1) 4. ἂρ τ 11 ἢ 
= je ae 
5. a 7 ie eee ee Pa 
ak 1+e 6. ax ae Ie = 1) 
ἼΩΝ ἘΣ Oe καὶ Ink 
7. a = a) ; ὃ. a, = es 
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Determine which of the following sequences {x;} converge in ®°, and find the limit of 
each convergent sequence. (In each case the vectors e1, e2, e3 are an orthonormal basis 
for ®3.) 


k+1 
k+2 


1 
9. x, = (1 + ἢ ey + eo + e3 10. x, = ae + kes + (—1)*es 


11. x, = ( — 27e1 + ae eo + (In kes 
k Ink 1 
eS ae oe τὰ 


13. Let {x;} be a convergent sequence of vectors in a Euclidean space. Prove that for 
every real number ε > 0 there exists an integer K such that 


[Xm — ΧΙ < ε 


whenever m,n > K. [Hint: Use the triangle inequality. ] 
14. In Chapter 10 it will be shown that 


lim ᾿ f(x) sin kx dx = 0 
kw ὦ --π 


for any function f in C[—7, π]. Use this fact to prove that the sequence {sin kx}, 
k = 1, 2,..., does not converge in the mean in C[—z, π]. 

15. Prove that the sequence {(sin kx)/k} converges in the mean in C[—z, z] to the zero 
function. Prove that this sequence also converges to zero for each x in the interval 
[--π, 7]. 

*16. (For students familiar with uniform convergence.) Let {f;,} be a sequence of func- 
tions in C[a, δ], and suppose that {f,} converges uniformly on [a, δ] to a function fin 
C[a, b];i.e., given any « > 0 there exists an integer k such that lfi(x) — f(xX)| < « 
for all k > K and all x in [a, δ]. Prove that {f,} also converges in the mean to f. 


8-2 SEQUENCES AND SERIES 


In this section we establish a number of elementary facts concerning convergence 
in Euclidean spaces. The first asserts that limits of sums and scalar products be- 
have entirely as expected, in the sense of 


Lemma 8-2. Let {x,} and {y,} be convergent sequences in a Euclidean 
space with limits x and y respectively. Then the sequence {ax + Byx} is 
convergent for every pair of real numbers a, B, and 


lim {ax, + Byx} = ax + By. 


The proof is an immediate consequence of Definition 8-1, and has been left to 
the student as an exercise (see Exercise 1 below). 
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For our purposes, a much more important property of convergence is that 
given by 


Theorem 8-1. Let {x,} and {y;} be convergent sequences in a Euclidean 
space with limits x and y, respectively. Then {χα + yx} is a convergent se- 
guence of real numbers, and 


lim {x,+y,} = xy. 
k—»+0 
In short, the inner product is a continuous function on a Euclidean space. 


Proof. We must show that 


lim (x: *yx) — (x-y)| = 9. 
To this end we set ur = Xt — Χ, Vit = Ye — Y, and write 


[(χε ye) — (ἃ y)| = |e + x)- (ve + y) — (ἃ .})} 
= [(κ - γι} + (x+vE) + (Y- uR)| 
< lug ve] + [x- vel + ly- ual, 
the last step following from Eq. (7-27), applied to @'. We now use the Schwarz 
inequality to deduce that 
Juz > Viel < [lusll [Ivell, 
Ix + ve] < [|x|] [lvell. 
< 


ly sux] < yl |lusll. 
Hence 


[(Χρ + YR) — G+ y)| < [{μ]} [vel] - Ux! livell + llyll uel, 
and since ||u;|| —> 0 and ||v;|| — 0 as k — oo, we have 
lim (xz ¥x) — (x-y)| = 0.1 


Now that we have introduced sequential convergence in Euclidean spaces, we 
can also discuss convergence of infinite series in the same context. Thus, with each 
series Σ χα Χμ in a Euclidean space we associate its sequence of partial sums 


{x1, Χι + Χο, X1 + Xo + X3, ...}, 


and then take the convergence of this sequence as the criterion for the convergence 
of the series in question. This is the content of 


Definition 8-2. An infinite series >>; 1 x; of vectors in a Euclidean space 
Ὁ is said to converge to the vector x in Ὃ if and only if the associated se- 
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quence of partial sums converges to x in the sense of Definition 8-1. If this 
is the case we write 


x = Σ᾽ Xk (8-3) 
k=l 


and say that x has been expanded as an infinite series. In greater detail, 
> κ--1 Χμ Converges to x if and only if for each real number € > 0, there exists 
an integer K such that 


nr 
> Xt — Xx|| < € (8-4) 
k=1 
whenevern > Κ. 
EXAMPLE. Let e;,...,€, be an orthonormal basis for ®”, and suppose Σ᾿ ¢—1 Xz 


15 an infinite series of vectors in ®”. Then 
οΟ οΌ οο 
>) xX = >) anes tte Σ᾽ ἀμκθι, 
k=l k=1 k=1 


where the a,, are the coordinates of x; with respect to the given basis, and it 
follows from Example 2 of the preceding section that >°;_1 x, converges to the 
vector X = a @; + τ + ane, if and only if 


oO wo 
> ai, os Ge ee 
k=1 k=1 


In particular, this result implies that the usual tests for the convergence of a series 
of real numbers such as the comparison test, the ratio test, etc., can be applied 
to determine whether or not an infinite series in R” converges. The only difference 
is that the tests must be applied n times, component by component. 


EXERCISES 


1. (a) Prove Lemma 8-2. 
(Ὁ) Let {a,} and {8;,} be convergent sequences of real numbers with limits a and 8, 
respectively, and let {x;,} and {γι} be as in Lemma 8-2. Prove that {a,xz + Biyx} 
converges to ax + By. 

2. (a) Let {x,} be a convergent sequence of vectors in a Euclidean space VU, and suppose 
that lim;_,.. {x;} = x. Prove that 


lim [(x, — x)*y] = 0 
k— 00 


for every vector y in U. 
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(Ὁ) Let U be a finite dimensional Euclidean space, and let {x;,} be a sequence of 
vectors in U. Suppose that there exists a vector x in Ὃ such that 


lim [(x, — x)+y] = 0 
k—>0o 


for all y in U. Prove that {x;,} converges to x in the sense of Definition 8-1. [Hint: 
Choose an orthonormal basis in V.] 

(c) Give an example to show that the result in (Ὁ) fails when Ὃ is infinite dimensional. 
[Hint: Let Ὃ be the space of all continuously differentiable functions on [—7, 7] with 
the standard inner product, let x, = coskx,k = 1,2,...,and letx = 0.] 
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In Section 7-4 we used the Gram-Schmidt orthogonalization process to prove 
that every finite dimensional Euclidean space has an orthonormal basis e;,.. . , €n, 
and that every vector in such a space can be written uniquely in the form 


X = (Χ  6.)61 ΠῚ (Ks en)en. (8-5) 


But the Gram-Schmidt process can be applied equally well in an infinite dimen- 
sional Euclidean space where it can be used to produce an infinite orthonormal set 
€1,@o,.... This fact suggests that an extended version of our earlier results may 
be within our grasp, and the remaining sections of the present chapter are devoted 
to realizing this suggestion. 

Before we begin, we emphasize that the ideas we are about to develop are 
natural and inevitable consequences of the study of finite dimensional Euclidean 
spaces, and should be understood as such. This, however, is not to deny their 
importance or to suggest that they are being presented as an academic exercise 
in generalization. Quite the contrary; for, as we shall see, these ideas lie at the 
heart of much of analysis and its applications to mathematical physics. 

The most obvious way in which to attempt to generalize (8-5) in the presence 
of an orthonormal set 61, e,... in an infinite dimensional space Ὃ 15 to replace 
its right-hand side by the infinite series 


> (x - exer. (8-6) 
k=1 


However, in the absence of any further information there is clearly no a priori 
reason for supposing that this series converges, much less that 1t converges to x.* 
Nevertheless, it is convenient to have a notation which expresses the fact that 


* Such a series is sometimes called a formal series, to emphasize the fact that on the 
face of things it is nothing more than an expression which actually may be devoid of 
meaning. 


314 CONVERGENCE IN EUCLIDEAN SPACES | CHAP. 8 


(8-6) is deduced from x, albeit in a purely formal way. The one most commonly 
used is 


xX ~ > (x + ex )ex, (8-7) 
k=1 


the symbol ~ (which, by the way, is no relative of the one used earlier for equiva- 
lence relations) being used to emphasize that the series in question may not con- 
verge to x. Of course, if it does, we write 


x = > (x - ex )ex, (8-8) 
k=1 


and say that the series converges in the mean fo x. In either case, the inner products 
x-e, are called the coordinates or (generalized) Fourier coefficients of x with 
respect to the orthonormal set 61, €2,.... 

It is clear that the Fourier coefficients of x depend upon the orthonormal set 
with respect to which they are computed. Not quite so clear, but equally true, is 
that (8-6) may converge in the mean to x for one orthonormal set but not for 
another. The following examples illustrate both of these points. 


EXAMPLE 1. Compute the generalized Fourier coefficients of the function 
I~) =x, --π ξχ “π, 
in C[—7, π] with respect to the orthonormal set 


sinx  sin2x  sin3x || (8-9) 
Va Va Va 


(see Example 2, Section 7-3). In this case the coefficients are 


τ 


I 
xe, = — xsinkx dx, k = 1,2,..., 
τ --τ 


and, using integration by parts, we obtain 


1 ᾿ ᾿ | l xcos kx! l . 
— xsin kx de = | — x00s bx ἘΠ cos kx dx| 
ν τ -τ ν΄ π k -τ Κ΄). 

ΞΞ — 20 cos kx 


is iat Oc eee 


avin, k= 2,4,6,.... 
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Hence the Fourier coefficients of x with respect to (8-9) are (—1)*—'(2\/x/k), 
and (8-7) becomes 


x~w 2 (sin x -- 


sin 2x sin 3x ae 2 
2 3 


In the next chapter we shall see that this series actually converges in the mean to 
x, so that we are justified in writing 


= sin kx 
x= 25) (-1)*'——- 
» k 


EXAMPLE 2. If we replace (8-9) with the orthonormal set 


1 , COS X cos 2x | 


— . (8-10) 
Vin Va ντ 
the generalized Fourier coefficients of x become 
1 τ i τ 
-ΞΞ x dx, and — xcoskx dx, k = 1,2,.... 


ν 2π"-τ Va dar 
But all of these integrals are zero (see Exercise 1), and hence (8-7) becomes 
x ~ 0. 


This time it is clear that we do not have an equality since 


|x|] = (J x? ax) = (5) »έ 0. 


We now return to the general situation in which 61, 6.,... is an (infinite) 
orthonormal set in U, and examine (8-6) a little more closely. The sum of the 
first n terms of this series is 


(x > e,)e; ae ets (x . Cn Jens 
which we recognize from Section 7-5 as the perpendicular projection of x onto 


the subspace Ὃ, of Ὃ spanned by the orthonormal vectors e;,...,e,. Hence, 
if w is any vector in U,, 


< |x — wi. (8-11) 


This simple observation furnishes the key to the proof of the following theorem. 
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Theorem 8-2. Let > κα axe, be any infinite series which converges in the 
mean to X; 1.é., 


X= Σ, AKL, (8-12) 
k=1 


Then a, = X-e, for each integer k. 


This theorem asserts that whenever x can be expressed as an infinite series the 
coefficients of the series are uniquely determined and must be the Fourier coeffi- 
cients of x with respect to the orthonormal set 61, e2,.... This, of course, is 
the infinite dimensional analog of the uniqueness of (8-5) in the finite dimensional 
case. 


Proof. Since 2 
>» Alek, 


we have 


for all n. Thus 


lim 


nN 


nr 
x — 2 (x + ex ex, 
k=1 


from which it follows that 


Subtracting this series from (8-12) gives 


5 [ar — (x-exdiex = 0, (8-13) 


a 
l 
-_ 


and we must now show that this equation implies a, — (x: 6.) = 0 for all k. 
But since the series in (8-13) converges in the mean to 0, we have 


n 1/2 
= lim (> [ας — (x: et = 0. 
k=1 


NO 


lim 


nO 


Σ [ae — (x exdler — 0 
k=1 


The desired conclusion now follows from the fact that each of the terms 
(a, — (x-e,)]” in this sum is non-negative. jf 
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In view of this result it seems reasonable to extend the meaning of the term 
“basis” to infinite dimensional Euclidean spaces as follows. 


Definition 8-3. An orthogonal set of vectors 61, €2,... in a Euclidean 
space Ὃ is said to be a basis for Ὃ if and ony if each vector x in U can be 
written uniquely in the form 


= >) aren. (8-14) 
k=1 


(Remember that such an equality must be interpreted as asserting that 
the series in question converges in the mean to x.) The coefficients a;, in 
this series are called the generalized Fourier coefficients of x with respect to 
the given basis, and the series itself is called the generalized Fourier series 
expansion of x. 


The reader should note that the vectors in a basis for U are only required to be 
orthogonal, not orthonormal. Of course, any basis for Ὃ can be normalized in 
the standard fashion, but it would be a hinderance to restrict the definition in this 
way. It is also possible to define a basis for an infinite dimensional Euclidean 
space by using a linearly independent set of vectors rather than an orthogonal one. 
This would be somewhat closer to the spirit of the definition in Chapter 1, but 
since any such set can be orthogonalized by the Gram-Schmidt process, it would 
not result in any significant gain in generality.* 

For all we know at the moment, we may never encounter an infinite dimensional 
Euclidean space with a basis. This notwithstanding, we shall assemble a number 
of results about such spaces pending the time when we finally meet one. However, 
in the absence of an immediate example it is only fair to state that these results 
are more than speculations in a vacuum since all of the Euclidean spaces which 
appear in analysis do, in fact, have bases. 

We begin by making a number of simple observations, the first of which we 
state formally as follows: 


Lemma 8-3. The zero vector is the only vector which is orthogonal to 
every vector in a basis for a Euclidean space WV. 


This is an immediate consequence of the postulated uniqueness of series expan- 
sions relative to a basis, and the fact that > >;_, a,e, converges in the mean to 
zero whenever a, = 0 for all k. Despite its simplicity, Lemma 8-3 is often useful, 
particularly in showing that an orthogonal set is not a basis for a given Euclidean 


* A word of warning. Definition 8-3 is not the only meaning assigned to the term 
“‘basis”’ for infinite dimensional spaces. There is another in common use which is not 
restricted to Euclidean spaces, but applies to arbitrary vector spaces as well. We mention 
this point only to alert the student to the fact that when he encounters this term he must 
check the definition to avoid serious errors. 
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space. For instance, when this result is combined with Example 2 above, it allows 
us to assert that the set of functions in (8-10) is not a basis for C[—7, z]. 

An equally simple observation is that an orthonormal set 61, @2, .. . is a basis for 
a Euclidean space Ὃ if and only if every vector x in Ὃ can be written in the form 


x = >> (x + €; ex. 
k=1 


For then, by Theorem 8-2, this expression must be unique, and Definition 8-3 is 
therefore satisfied. 

And while on the subject of orthonormal bases, there is another point it would 
do well to settle. Recall that if e,;,...,e, is such a basis in a finite dimensional 
Space, and if 


n nr 
x= Σ) (Χο) and y= Σ᾽ (y-ex)e: 
k=1 k=1 
are any two vectors in this space, then 
nr 
ΧΟΥ = δ᾽ (x-ex)(y- ex). 
k=1 


That is, the inner product of x and y is the sum of the products of their cor- 
responding components when computed with respect to an orthonormal basis. 
We assert that this result is also valid for an orthonormal basis in an infinite dimen- 
sional space Ὅ. 

To prove this assertion, let 


x = 3 (x-e,e, and y= > even 


k=1 


be any pair of vectors in U, and for each positive integer n, set 
γι nr 
Xn = δ᾽) (x-exler and yn = δ᾽ (y- exer. 
k=1 k=1 


Then {x,} — x and {y,} — y, and hence by Theorem 8-1, 
{Xn * Yn} XY. (8-15) 


But the fact that 61, eo, .. . is an orthonormal set implies that 


Xn*Yn = > (x + ex)(y " ex), 


k=1 


and it follows at once from (8-15) that 


x°y= > (x - ex)(y . ex). (8-16) 
k=1 
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EXERCISES 


1. Verify that 


τ 


: | xax = 0 and we xcoskxdx =0, k = 1,2,... 


/ 2x Va J 
2. Compute the Fourier coefficients of the function 
fx) =x, -wSx<r 


in C[—2, π] with respect to the orthonormal set 


1 , COs x cos 2x 
V 2a “τ νπ 


and also with respect to the orthonormal set 


9 8. 5.19: 


sinx sin 2x 
Jr Ve 
3. Repeat Exercise 2 for the function e*, --π <x <7. 
4. Let 61, e2,... bean infinite orthonormal set in a Euclidean space VU, and suppose that 


οο 
> a,ye, = 0. 
k=1 


Prove that a, = 0 for all k. 


8-4 BESSEL’S INEQUALITY: PARSEVAL’S EQUALITY 


This section bears the title of two of the most important results in the theory of 
infinite dimensional Euclidean spaces. As we shall see, both of them can be 
interpreted as natural extensions of familiar statements about finite dimensional 
spaces. This fact, however, should not be allowed to obscure the importance of 
the generalizations themselves, and the reader is advised that they will ultimately 
furnish the justification for most of our work with orthogonal sequences in func- 
tion spaces. 


Theorem 8-3. Lete,, @o,... be an orthonormal set of vectors in an infinite 
dimensional Euclidean space 0, and let x be an arbitrary vector in 0%. Then 


oo 


yD; (x-ex)* < {[χ||2 (Bessel’s inequality). (8-17) 
k=1 
Moreover, 61. @2,... is a basis for Ὃ if and only if 


> (χ - ει) = ||x||?  (Parseval’s equality). (8-18) 
k=1 
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Proof. The proof rests upon computing the value of 


2 


nr 
x — ys (x - ex )ex 
k=1 


for any x in U and any integer n. Now 


= ρ - 3 (x -ener)-(+ = 53 (x: oe) 
k=1 k=1 
= xx —2 3 (x -e,)(x* ex) + ΠῚ (x: oe) ὴ (3 (x ene) : 


2 


x — 3 (x - €; ex 
k=1 


(We have changed the index of summation on the first factor of the last term for 
convenience in computation.) But since the e;, are orthonormal, e;-e, = δ᾽: 
and it follows that 


(3 (x - oe) : (5 (x: ae) = >> 
jail k=1 j=lk 


; (x - e;)(x - ex)(e; + ex) 
1 


= > (x + ex)”. 
k=1 
Thus 
n 2 n 
x — >> (x-exex|) = Ix? — >) (ἃ - ex)’. (8-19) 
k=1 k=1 


To prove Bessel’s inequality, it suffices to note that 


nm. 2 n 
0 « IIx — > (x-e,)ex|| = IIx]? = >, (x + ex)? 
k=1 k=1 


for all x in U and all nm. Hence 


(xe)? < |x|? 


Ms 


a 
I 


for all n, and the partial sums of the series S41 (Xe)? form a bounded non- 
decreasing sequence of non-negative real numbers. By a well-known theorem 
from calculus (see Appendix I) we conclude that this series converges and that 


( - 6.)}" < [[χ]}". 


Me 


Ὧν 
| 
μι 


Thus (8--17) holds. 


8-4 | BESSEL'S INEQUALITY: PARSEVAL’S EQUALITY 321 


To finish the proof we now suppose that e;,€2,... 15 an orthonormal basis 
for U. Then by Theorem 8-2 we know that 


x = 3 (x + €;,)ex. 
k=1 


Hence 
2 
lim 


no 


| 
Θ 


x -- >. (x + ex ex 
k=1 
and it follows from (8-19) that 


lim ix =o -00 = 0. 
Thus : 
Σ᾽ (x-ex)” = [|χ|", 
ἐπεὶ 


which is Parseval’s equality. Finally, since the steps in this chain of reasoning are 
reversible, we conclude that 61, 62,. .. is a basis whenever Parseval’s equality is 
satisfied, and the proof is complete. ἢ 


In a finite dimensional Euclidean space the square of the length of any vector 
is equal to the sum of the squares of the lengths of its components relative to an 
orthonormal basis. Conversely, if this is true the set in question is an orthonormal 
basis for the space. Parseval’s equality asserts that this result also holds for infinite 
dimensional spaces, and thus can be viewed as an infinite dimensional version of the 
Pythagorean theorem. Its value lies in the fact that it provides an analytic tool 
for determining whether an orthonormal set is a basis for a Euclidean space, and 
as such is much easier to apply than the definition itself. 

Bessel’s inequality—whose geometric interpretation is now obvious—can be 
used to obtain estimates of the magnitude of the Fourier coefficients of x with 
respect to 61, €2,.... One of the most important of the many results of this sort 
is given in the following corollary. 


Corollary 8-1. 1061, eo, ... is an orthonormal set in an infinite dimensional 
Euclidean space Ὃ, then 


lim (x-e;,) = 0 (8-20) 
k—0 


for every x in Ὅ. That is, the Fourier coefficients of x tend to zeroask—+ οὐ 
for any orthonormal set in Ὅ. 


Indeed, Bessel’s inequality implies that }>7_1 (x- ex)” is a convergent series of 
real numbers. Hence the individual terms in this series approach zero with in- 
creasing k, which, in turn, implies (8-20). 
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In applications one frequently wants to work with an orthogonal set in Ὃ rather 
than an orthonormal one. To do so we must know which of the results proved 
for orthonormal sets remain true for orthogonal sets. The fact of the matter is 
that, save for minor notational changes, they all do. This statement finds its 
justification in the following assertion, whose proof we leave as an exercise. An 
orthogonal set 61, €2,... is a basis in a Euclidean space Ὃ if and only if its asso- 
ciated orthonormal set e;/||e,||, €2/|\e2||, .. . is a basis. 

From this it follows that we can rephrase all of our earlier results in terms of 
orthogonal sets. In particular, if e;,eo,...is an arbitrary basis for U, Parseval’s 
equality becomes 


IIx|]? = Σ (x + ex)" ex)” => 5 (x: ( - ex)” : (8-21) 


€y, + Ck -llesll? 


and, conversely, if (8-21) is satisfied for all x in Ὃ, e1,eo,... is a basis for V. 
Finally, the series expansion of a vector in terms of an arbitrary basis is 


= X° ey 
x = Ck (8-22) 
2s Tex? Ὁ 
where the 
X* ey 
llex||? 
are the generalized Fourier coefficients of x with respect to e;,@9,.... This 


formula will be used repeatedly throughout the following chapters. 


EXERCISES 


1. Let e1, e2,... be an orthogonal set in a Euclidean space VU. Prove that this set is a 
basis for U if and only if its associated orthonormal set is a basis. 

2. Prove Formula (8-21). 

3. Assume that the functions 1, sin x, cos x,..., sin kx, cos kx,...are a basis for the 
Euclidean space C[—7, 7]. (They are.) Find the Fourier coefficients of fin C[—7, 7] 
in terms of this basis. What is the series expansion of f? 


*8-5 CLOSED SUBSPACES 


Roughly speaking, a Euclidean space is an object in which the notions of linearity 
and convergence are studied simultaneously. A particularly simple yet important 
example of the way in which these ideas enrich and support one another 15 fur- 
nished by the study of subspaces of Euclidean spaces. In this instance the notion 
of convergence intervenes to produce what is known as a “‘closed”’ subspace, de- 
fined as follows. 
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Definition 8-4. A subspace ‘W of a Euclidean space Ὃ is said to be closed 
in Ὃ if the limit of every convergent sequence of vectors in ‘W belongs to W. 


(In those cases where the context is clear we shall omit the reference to 0, and 
simply say that ‘W is a closed subspace.) 

As with every new definition, one’s first thought is to produce examples. In 
this case we can furnish a plentiful supply by examining finite dimensional spaces, 
for there we can prove 


Lemma 8-4. Every subspace ‘W of a finite dimensional Euclidean space 0 
is closed. 


Proof. If W is the trivial subspace of Ὃ it is obviously closed, and we are done. 
Otherwise we can find an orthonormal basis e;,.. . , θη for U whose first m vectors 
€1,..-, mare a basis for W.* It follows that an arbitrary vector x in U belongs 
to Ww if and only if its last » — m components with respect to this basis are Zero. 

Now suppose that {x,} is a sequence of vectors in W, and that {Χμ} — x. 
Then, by Example 2 of Section 8-1, we know that the sequences of real numbers 
formed from the components of the x, converge to the components of x. It 
follows that the last n — m components of x are zero, and hence x belongs to W, 
as asserted. J 


More generally, it can be shown that every finite dimensional subspace of an 
arbitrary Euclidean space is closed. The proof is almost identical with the one 
just given, and has been left as an exercise. 

This lemma tells us that the only interesting illustrations of Definition 8-4 are 
to be found in infinite dimensional spaces, if any exist at all. They do, as the 
following example shows. 


EXAMPLE. Let 4. (read “little ¢ two”) denote the set of all infinite sequences 
of real numbers 
x = (x1, X2,X3,-- .) 


co 

2 
> Xi < ©. 
k=1 


Then £, becomes a Euclidean space if, with x as above, a a real number, and 
y = (11, Y2, ¥3,---), we define 


with the property that 


ax = (ax, aX 9,5 aX3,...) 
x+y = (%1 + V1, X2 + Ya, ΧΆ + Y3,---) 
X°Y = Xy1 + Xovo2 + X38¥3 + °°" 


* This assertion can be proved at once by applying the Gram-Schmidt process to the 
basis described in Theorem 1-7. 
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(see Exercise 2). Moreover, since {2 contains the infinite orthornormal sequence 


ει = (1,0,0,...), 
€2 = (0, 1, 0, “Ὁ . 
(0,0, 1,...), 


63 


it is infinite dimensional. 

Now let ‘W be the set of all vectors in £2 which have only a finite number of 
nonzero components. Then ‘W is a subspace of £5. (Proof?) However, ‘W is not 
closed in fg since the sequence 


x, = (4,0,0,...), 
Xo = (3, 1: 0, . ’ 
x3 = (3, 1: ἑ, : )s 
each of whose vectors belongs to W, converges to the vector (4, 4, 3,..., 1/2*,...) 


which is not in W. 
(The Euclidean space 2 is an example of what mathematicians call a Hilbert 
space.) 


Having shown that there exist subspaces which are not closed, and hence that 
there is good reason for studying closed subspaces as entities in themselves, we 
begin with the usual elementary observations. First, every Euclidean space Ὁ, 
viewed as a subspace of itself, is closed, and hence every subspace of Ὃ (closed 
or not) is contained in at least one closed subspace of U. Next, the intersection 
of any collection of closed subspaces of Ὃ is itself a closed subspace. (Recall that 
this intersection consists of those vectors which belong to every one of the sub- 
spaces in question. Again the proof is deferred to the exercises.) Conclusion: If 
Ἃ is an arbitrary subspace of a Euclidean space VU, there exists a smallest closed 
subspace of © containing ‘W; namely the intersection of al/ the closed subspaces 
of Ὁ which contain W. This subspace is denoted W, and, for obvious reasons, 
is called the closure of Ὃ in 0. Finally, W can be described as follows. 


Lemma 8-5. Jf‘ is a subspace of a Euclidean space Ὃ, its closure (in 0) 
is the set of all vectors in © which are limits of sequences of vectors in W. 


In other words, to get W we simply adjoin to W all limits of sequences of vectors 
in Ἂν. The proof of this statement is an obvious consequence of our definitions. 

In specific cases this lemma is far too general to be of much use in finding Ὅν. 
In fact, many of the deeper investigations of the theory of Euclidean spaces center 
around the problem of determining ἊΝ for a given W. Unfortunately, most of 
this work is highly technical, and beyond the scope of this book. 
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The sequence of observations leading to Lemma 8-5 admits a useful and natural 
generalization. Suppose that instead of starting with a subspace of U we begin 
with an arbitrary nonempty subset X in U. Then we can form the subspace S(X) 
spanned by δ, and follow this with the closure $(9) of S(&) in Ὁ, in which case 
we say that S(X) is the closed subspace of U generated by X. Note that the sub- 
space spanned by X coincides with the subspace generated by & if and only if 
8(X) = 8(X). This will always happen, of course, if Ὃ is finite dimensional (Lemma 
8-4), or if X is a finite subset of Ὃ (Exercise 10). However, the above example 
shows that when X is an infinite subset of an infinite dimensional space, $(&X) will 
in general be different from 8(%X). In Chapter 1 we gave a description of the vectors 
belonging to $(9) in terms of the vectors belonging to X (see Theorem 1-1). When 
combined with Lemma 8-5, that description allows us to assert that S() consists 
of all vectors in Ὃ which are limits of linear combinations of vectors in X. Stated 
more formally, we have 


Lemma 8-6. Let X be a set of generators of a (necessarily closed) subspace 
Ὁ) of a Euclidean space 0. Then, if € is any positive real number, and x any 
vector in W, there exists a finite linear combination ΣΝ ᾿ς a,x; of vectors Xx; 
in 8 such that 


N 
DO 


Finally, suppose that 9 is a set of generators for Ὃ itself, and that the vectors in ἃ 
are also linearly independent.* On the strength of our experience with finite dimen- 
sional spaces the reader could hardly be blamed for assuming that every vector 
x in Ὁ could then be written in the form 


οΌ 
= Σ᾽ axi, 
k=] 


where the a; are scalars, and the x; belong to X. Surprisingly, this is not the case, 
and an example of this apparently paradoxical situation can be found in Exercise 
13 below. However, things improve remarkably when &X is also an orthonormal (or 
orthogonal) set, for then we can prove 


Lemma 8-7. 7761. €2,...is an orthonormal set of generators of a Euclidean 
space VU, then 61. €2,... is a basis for V. 


Proof. We must show that every vector x in U can be written in the form 


to] 


= 3 (xX + e€x)ex. 


* It can be shown that such a set always exists in any Euclidean space U. The proof, 
however, is not easy. 
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To do so, let € > 0 be given. Then, since the e; generate U we can find a linear 
combination Σ Κ΄... a,e, such that 


Ifn > N, it follows by two applications of (8-11) that 


n N 
x— Σ᾽ (x-exex| < = aa (Χ + ex )ex 
k=1 k=1 
N 
< ἜΣ" ὥκθχ 


Hence, by the definition of convergence, 
0 
an >» (x 5 C4 )eks 
k=1 
and the lemma is proved. J 


This result explains why orthonormal sets enjoy a special status in the theory of 
infinite dimensional Euclidean spaces beyond what they have in finite dimensional 
spaces. In the latter their use is simply a matter of convenience, in the former it 
is often a matter of necessity. Since we shall be dealing aJmost exclusively with 
orthonormal (and orthogonal) sets in the following chapters, it may be well to 
summarize what we now know about them. Our results may be stated in the 
following form. 


Theorem 8-4. Jf e;, 2, ... is an orthonormal set in an infinite dimensional 
Euclidean space 0, then the following three statements are equivalent (i.e., 
any one implies the other two): 

(1) €1,@o,... is a basis for V; 

(ii) 61, @g,... is a linearly independent set of generators for VU; 
(iii) If x is any vector in V, then ||x||? = par (χ- ex)”. 


There is, of course, a corresponding theorem for orthogonal sets. 


EXERCISES 


1. Prove that every finite dimensional subspace ἊΝ of a Euclidean space Ὦ is closed. 
[Hint: If x is the limit of a sequence of vectors in‘W, apply Lemma 8-4 to the sub- 
space of Ὃ spanned by Ἂν and x.] 


*12; 
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. Let ἔς be as defined in the example in the text, and let 


KS hi ey Ree es); Υ = (1, )2,---5Vko---) 


be arbitrary vectors in ἔς. 
(a) Prove that x + y belongs to 2. [Hint: Use Eq. (7-27) to deduce that 


n 1/2 n ᾿ 1/2 n 1/2 
( (xz + ») < (S 4) zie (> ἢ ᾿ 
k=1 k=1 k=1 


and then use the fact that x and y belong to £2 to obtain an upper bound, independent 
of n, for the right-hand side of this inequality.] 


(Ὁ) Prove that x-y is defined. [Hint: For any two real numbers x, y, we have 
xy = $[(x + y)? — x* — y?]. Hence 


n n n n 
EST = (Σ (xe + Yk)” — Σ =z Σ ἢ ] 
k=1 k=1 k=1 k=1 


(c) Now complete the verification that ἔς is a Euclidean space. 


. (a) Prove that the subset W defined in the text is a subspace of 2. 


(b) Find the closure of W in £2. 


. In the example above it was asserted that a certain sequence in ¢2 converged to the 


vector (4, 4, 4,...). Prove this assertion. 


. Prove that the intersection of any (nonempty) collection of closed subspaces of a 


Euclidean space Ὃ is closed. 


. Give an example of a Euclidean space ‘W which is a subspace of the Euclidean spaces 


U1 and Us, and which has the property that it is closed in Ὃ 1 but not in U2. (Thus 
in the definition of a closed subspace reference must be made to the space in which 
the closure is taking place.) 


. Prove that ἂν = ὧν for any subspace ‘W of a Euclidean space Ὃ. (This result is 


sometimes expressed by saying that “‘the closure of the closure is the closure.”’) 


. Prove Lemma 8-5. 

. Prove that‘W is a closed subspace of Ὃ if and only if W = ‘W. [Hint: See Exercise 7.] 
. Prove that S(9) is closed in © whenever & is a finite subset of Ὁ. 

. Suppose x is orthogonal to a subspace W of a Euclidean space Ὃ (i.e.,x-y = 0 for 


every y in‘W). Prove that x is orthogonal to Ἂν. [Hint: Use Theorem 8-1.] 


Let ‘W be an arbitrary subspace of a Euclidean space VU, and let W+ denote the set 
of all vectors in U which are orthogonal to ἊΨ (see Exercise 23, Section 7-5). Prove 
that ἊΝ τ is a closed subspace of U. [Hint: Let {x,} be a sequence in W+ which con- 
verges to x, and let y be any vector in°W. To prove that x - y = 0, use the identity 


x-y = y+ (xk — xXx) 


and the Schwarz inequality.] 
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14. 


CONVERGENCE ΙΝ EUCLIDEAN SPACES | CHAP. 8 


Let £2 be the Euclidean space defined above, and for each integer k > 2 let x; 
be the vector in £2 defined by 


x, = (1,0,...,0,1,0,...), 


where the ones occur in the first and kth positions. Let X denote the set consisting 
of the vectors x2, x3,.. 

(a) Show that ἃ is a linearly independent set in £2. 

(Ὁ) Describe the subspace $(X°). That is, give a rule which can be applied to test 
whether or not a given vector in £2 belongs to S(X). 

(c) Show that the vector δι = (1,0, 0,...) belongs to $(X). [Hint: Compute the 
value of 


and show that 


: , 


(d) Prove that 8(00) = 2. [Hint: Begin by showing that each of the vectors e1, 
eo,... as defined in the text belong to $(9C), and then show that these vectors are 
a basis for f2.] 

(e) Show that δι cannot be written in the form > °;—~2 a,x;, thereby furnishing the 
example mentioned just before Lemma 8-7. 

Let {a,},k = 1,2,..., be a sequence of real numbers, and suppose that Σ᾿ ;—1 a7 
converges. Prove that }>;—1 a:/k also converges. Give an example to show that 
the converse of this statement is false. 


9 


fourier series 


9-1 INTRODUCTION 


Although we now know a great deal about the general theory of orthogonal 
series in infinite dimensional Euclidean spaces we have yet to produce a single 
concrete example of such a series. To fill this gap in our knowledge we propose 
to devote the next three chapters to a detailed study of several types of series 
expansions in infinite dimensional function spaces. In each case we shall begin, 
as of course we must, by exhibiting a basis for the particular space in which the 
series is to be constructed. Once this has been done the series in question will 
appear as a special version of our earlier results, and for this reason the following 
discussion can be viewed as a collection of elaborate examples in illustration of 
material that is already known. 

At the same time, however, it is only fair to warn the reader that each of the 
series which we shall construct is of significant importance in physics and applied 
mathematics. Indeed, since 1822 when Jean Baptiste Fourier first solved the 
problem of heat flow in solid bodies by means of those series which now bear his 
name, this subject has grown until, at present, it is an entire branch of mathe- 
matics and mathematical physics. Later in this book we shall examine some of 
the applications of this theory, but first we discuss the series themselves. 


9-2 THE SPACE OF PIECEWISE CONTINUOUS FUNCTIONS 


Given the importance of the various series which we are about to consider, it is 
clearly of some interest to phrase the following discussion so as to encompass as 
wide a class of functions as possible. Unfortunately, most of the generalizations 
which go beyond the space of continuous functions are highly technical and in- 
accessible in a course at this level. Still, it is possible to extend our results to in- 
clude piecewise continuous functions, and since this modest generalization is well 
worth making, we shall devote the present section to showing how the set of all 
such functions on a fixed interval can be made into a Euclidean space. For con- 
venience we begin by recalling the definition of piecewise continuity. 
329 
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Definition 9-1. A real valued function fis said to be piecewise continuous 
on an interval [a, δ] if 
(i) fis defined and continuous at all but a finite number of points of [a, δ] 
and 
(ii) the limits 

fod) = {πὶ fxo + A), 


f(xo) = lim f(xo — ἢ) 
hot 


(9-1) 


exist at each point x9 in [a, 6]. (Note that only one of these limits is relevant 
if Xo is an end point of [a, }].) 


We remind the reader that the nota- 
tion ἢ — ΟΥ means ἢ approaches zero 
through positive values only, and that 
the two limits appearing in (9-1) are 
called, respectively, the right- and left- 
hand limits of f at xo. When xo 15 a 
point of continuity of f each of these 
limits is equal to the value of fat x9, ὁ ——__|_ _________l χ 


and we then have 


fxs) = flo) = feo). 


More generally, the requirement that both of these limits be finite everywhere in 
[a, Ὁ] implies that the only discontinuities of f are “‘jump discontinuities” of the 
type shown in Fig. 9-1. Moreover, the difference 


fxd) -- fxo) 


measures the magnitude of the jump of the function fat xo. 


FIGURE 9-1 


foy=* 


FIGURE 9-2 FIGURE 9-3 
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Thus, for example, the function 


x, 0<x <l, 


(x) = 
! l—x, 1<x <2, 


(see Fig. 9-2) is piecewise continuous on the interval [0, 2] and has a jump dis- 
continuity of magnitude —1 at x = 1, since f(1t) = 0 while f(17) = 1. On 
the other hand, the functions 1/x and sin 1/x fail to be piecewise continuous on 
any interval containing the origin because of their behavior as x -- Ὁ. (See 
Figs. 9-3 and 9-4.) 


FIGURE 9-4 


The following facts concerning piecewise continuous functions are of particular 
importance, and will be used repeatedly hereafter. 


1. If fis piecewise continuous on [a, δ], then 


[fos ax 


exists, and is independent of whatever values (if any) f assumes at its points of 
discontinuity. In particular, if f and g are identical everywhere in [a, b] save at 
their points of discontinuity, then 


i ΟΞ [ “SONG 


2. If f and g are piecewise continuous on [a, b], then so is their product fg. 
(See Exercise 11.) This, together with (1) implies that the integral of the product 
of two piecewise continuous functions always exists. 

3. Every continuous function on [a, b] is piecewise continuous. 

This said, we now turn our attention to the problem of converting the set of 


piecewise continuous functions on [a, b] into a Euclidean space. In view of the 
fact that this set includes the continuous functions on [a, ὁ] it is only reasonable 
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to require our construction to be so conceived that the resulting Euclidean space 
has C[a, δ] as a subspace. This, in turn, suggests that we define f- g by the formula 


ὃ 
fig = | fixe) dx. (9-2) 


But does (9-2) actually yield an inner product on the set of piecewise continuous 
functions on [a, b]? The unpleasant answer is, No. To see what goes wrong, let 
n(x) be a function which is zero everywhere in [a, δ] except at a finite number of 
points (see Fig. 9-5). Such a function 

is said to be a null function, and has the ὲ 
annoying property that 


b 
[ n(x)” dx = 0 FIGURE 9-5 


in spite of the fact that n is not the zero function. This, of course, vitiates using 
(9-2) as an inner product, since, by definition, the inner product of a nonzero 
vector with itself cannot be zero. 

It is perfectly clear, however, that the above difficulty will disappear if we over- 
look the fact that a null function is not identically zero, and treat it as if it were. 
But then, to be consistent, we must also regard any two piecewise continuous func- 
tions as identical whenever they differ at only a finite number of points. And this is 
just what needs to be done to make (9-2) yield an inner product. 

As usual, there are a number of facts which have to be verified before such an 
assertion can be accepted. Among them we call attention to the need to ascertain 
that (9-2) respects our identification of functions. In other words, we must show 
that whenever /; is identified with κα and g, with g, then 


b ὃ 
[ποϑειοὺ dx = [ fodg@) ax. 


For only then will (9-2) unambiguously define an inner product on the set of 
piecewise continuous functions identified as above. This, however, is easy to 
prove, and has been left to the reader as an exercise (see Exercise 5). 

Finally, to complete the argument, we observe that whenever /; is identified 
with f, and g, with g, then f; + g is identified with f + g, and af; with af for 
all real numbers a. Thus functional addition and multiplication by real numbers 
also respect our identification of functions, and it follows that the set of piecewise 
continuous functions on a fixed interval [a, b], identified as above, is a Euclidean 
space. We shall denote this space by @C[a, δ], and assert without proof that it 
contains C[a, δ] as a subspace (Exercise 2). 

Now that we have rigorously constructed the space @C[a, δ] and insisted that 
its vectors are collections of functions identified with one another, it is perfectly 
clear that we can ignore this fact and treat these vectors as though they were 
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ordinary functions. This is precisely what we shall do henceforth, but always with 
the tacit understanding that the facts of the matter are as outlined above, and that 
all of our arguments can be rigorously restated, if necessary. As with all such 
abuses of terminology, this involves no real danger of error, and has the positive 
result of simplifying language and notation. 


EXERCISES 


1. For each of the following functions evaluate the right- and left-hand limits at all 
points of discontinuity, and state whether or not the function is piecewise continuous 


on [0, 2]. 
0, x=0 
x 0<x<1 _y 
ace ames ek = (Ὁ) f(x) = 
eee Πτν- ts o<x<2 
x —2x+1 
(©) fe) Ἐ7ετ τοτ ’Ῥ θΞ χε: tent =o 5s 
1, ee, a *— 1, LS XS 
Ι, O< x <3 x 
< <a 
(e) f(x) =)0, <x <3 0 f= στ O0<x<1 
ὅν B<x<2 2x, l<x<2 


2. (a) Suppose a piecewise continuous function fis identified with a continuous func- 
tion g in @@[a, δ]. What can be said about the magnitudes of the jump discon- 
tinuities of f? 

(Ὁ) Use the result in (a) to prove that C[a, δ] is a subspace of @C[a, δ]. 
3. Determine whether or not the following functions are piecewise continuous on [0, 1]. 


π 
xsin-» 0 «χ «! 
(a) yo) =| x 
0, x =0 
1, if x is irrational 
(b) f(x) = 
0, if x is rational 
OF) Sees eS 
aed τ Fat Sp? 2 = 0,1,2,... 


4. Prove that ἢ and f2 are identified in @C[a, ὁ] if and only if fj — /2 isa null function. 


5. Let fand g be piecewise continuous on [a, 6], and suppose that ἡ is identified with 
f, and g; with g. Prove that 


b b 
[λοι dx = [foe de. 


[Hint: Note that figi — fg = figi — fig + fig — fg.] 
6. Verify the assertion that @C[a, b] is a Euclidean space. 
7. Are the functions 1, x, x?,... linearly independent in @C[a, b]? Why? 
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8. Prove that the functions 


WX . WX ATX . ANX 
1, cos —? sin SS BHO ED Cos $ sin ———~ 5 rr 8 
a a a a 


are linearly independent in @C[—a, a]. 
9. Prove that ||f — g|| = 0 in @C[a, 6] if and only if f — g is a null function. 

#10. Let f; and gi be piecewise continuous on [a, 6], and write fi ~ fe if and only if 
fi — fz is a null function. Prove that this defines an equivalence relation on the set 
of all piecewise continuous functions on [a, b], and that the equivalence classes it 
defines are the elements of @C[a, 6]. (See Section 1-9.) 

11. Let fand g be piecewise continuous on the interval [a, 6], and let fg denote their 
product; that is, fg is the function defined by 


fax) = f(x)g) 


for all x in [a, Ὁ]. Prove that fg is piecewise continuous on [a, b], and thus deduce 
that the integral in (9-2) exists. [Hint: Use the fact that the product of continuous 
functions is continuous. ] 


9-3 EVEN AND ODD FUNCTIONS 


The task of evaluating the integrals which arise in the study of orthogonal series 
can often be simplified by exploiting the symmetry of the functions involved. This 
technique is usually formalized by introducing the notions of even and odd 
functions, as follows. 


Definition 9-2. A function f, defined on an interval centered at the origin, 
is said to be even if 


f(—x) = Ff) (9-3) 
for all x in the domain of f, and odd if 
f(-—x) = -- ὦ}. (9-4) 


This, of course, is just another way of saying that a function is even if its graph 15 
symmetric about the vertical axis (Fig. 9-6), and odd if its graph is symmetric 


FIGURE 9-7 


FIGURE 9-6 
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about the origin (Fig. 9-7). Thus, for integral values of n, x” is even if n is even, 
odd if n is odd, a fact which helps explain the particular terminology used in 
this context. 


The importance of even and odd functions for our work stems from the equalities 
[ fix) dx = 2 [ “ f(x) dx (9-5) 

whenever / is even and integrable, and 
[. fix) dx = 0 (9-6) 


whenever f is odd and integrable. Both of these assertions are easy consequences 
of the above definition (see Exercise 2), and are also evident from the geometric 
interpretation of the definite integral as area. 

An equally elementary observation is that the product of two functions is even 
whenever both of the functions are even or both are odd, and is odd whenever 
one of the functions is even and one odd. In short, the multiplication of even 
and odd functions obeys the rules 


(Even)(Even) = (Odd)(Odd) = Even, 
(Even)(Odd) = (Odd)(Even) = Odd. 


From this, and (9-6), we deduce that 
[fe gd dx = 0 


whenever f and g have the opposite parity. Hence even and odd functions in 
@C[ —a, a} are mutually orthogonal. 


EXAMPLE 1. The functions 
1, cos x, cos 2x,... 
are even in @C[—a, a], and 
sin x, sin2x,... 
are odd. Thus 


I 
Θ 


[ " f(x) cos kx dx 
if f is odd, and 


[ f(x) sin kx dx = 0 


if f is even. The value of these results for computing Fourier coefficients is too 
obvious to need comment. 
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A somewhat less obvious property of even and odd functions is established in 
the following lemma. 


Lemma 9-1. Every function on the interval [—a, a] can be written in exactly 
one way as the sum of an even function and an odd function. 


Proof. Let f be an arbitrary function on [—a, a], and set 


fu(x) ΞΞ f(x) FAM, fo(x) ἘΞ: f(x) eles (9-7) 


It is trivial to verify that fg is even, fo odd, and that f = fe + fo. Thus f has 
at least one decomposition of the desired form, and it remains to show that this 
is the only such. To this end, suppose that we also had f = gg + go, with gr 
even, and go odd. Then fg + fo = ge + go, and 


fe — σὲ = 80 — fo. 


But the difference of two even functions is even, and the difference of two odd 
functions is odd. Thus the function defined by the above identity 1s simultaneously 
even and odd, and so must be the zero function. In other words, fe — gz = 
Zo — fo = 0, and it follows that gz = fr, go = fo, as desired. J 


The functions fg and fo defined in (9-7) are known respectively as the even 
and odd parts of f. 


EXAMPLE 2. If f(x) = εὖ, then 


e+e” igo 


οἷ 
fax) = 5 and fo(x) = ——<—- 
Thus the even and odd parts of the exponential function are the hyperbolic cosine 


and hyperbolic sine, respectively. 


EXERCISES 


1. Classify each of the following functions as even, odd, or neither even nor odd. 


(a) tan x (b) é (c) ΣΞῸ (4) In |x| 
2 
χ τ ἢ --1 χ 
απ OX Bese OY CFDED 
o2S Φ ΚΑΙ, fdefined in [0, a] 


x—1 
2. Prove Eqs. (9-5) and (9-6) of the text. 
3. Establish the multiplicative rules for even and odd functions given in the text. 


7. 


8. 


10. 


1. 


12. 


13. 
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. Show that 


Γ[Γ Νὼ Cosme ἀρ αι = +f" FG) copula edu 
0 J—r = 


afd TT 


for any piecewise continuous function f on the interval [—7, π]. 


. Let fbe differentiable in the interval [—a, a]. Prove that f’ is odd whenever fis even, 


and even whenever / is odd. 


. Let f be an integrable function defined in the interval [—a, a], and let 


F(x) = [ fd, -a<x<a. 


Prove that F is even if fis odd, and odd if fis even. 
Decompose each of the following functions into its even and odd parts. 


2 
x+ 1 x +1 
(a) eee (b) rare | (c) x cos x — cos 2x (d) ra 
1 
as ll 
(e) ae hee a, b, c constants, not all zero 


Find the even and odd parts of the function 


a 
f(x) = > anx’, a; constants. 
=0 


. Find the even and odd parts of the function 


f(x) = > + Σ (a, cos kx + b, sin kx), ax, δὲ constants. 
ee π᾿ 


Let &[—a, a] denote the set of all even piecewise continuous functions on the interval 
[—a, a], and let O[—a, a] denote the set of all odd piecewise continuous functions on 
[—a,a]. Prove that &[—a, a] and O[—a, a] are subspaces of PC[—a, a]. 

Prove that the zero function is the only function which is simultaneously even and 
odd on [—a, a]. 

Let po(x), pi(x), .. . be the sequence of polynomials obtained by applying the Gram- 
Schmidt orthogonalization process to 1,x,x?,...in [—1,1] (see Example 3, 
Section 7-4). Show that po;(x) is an even function, and that po,41(x) is an odd func- 
tion for all values of k. [Hint: Use mathematical induction.] 


Let f be piecewise continuous on [—a, a], and suppose that fis orthogonal to every 
even function in @C[—a, a]. Prove that fis odd. [Hint: Use Lemma 9-1.] 


9-4 FOURIER SERIES 


In this section we begin our study of orthogonal series by considering series 
expansions relative to the functions 


1, cos x, sin x, cos 2x, sin2x, .... (9-8) 
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We have already seen that these functions are mutually orthogonal in @C[—-, 7], 
and we shall prove shortly that they are a basis as well. Granting the truth of this 
fact, we can then use Formula (8-22) to write any piecewise continuous function 
f on the interval [—7, 7] in the form 


fy = Sey ἔξ: So τ ως κα] (mean) (9-9) 


EP -- ||sin kx]? 


where the notation “(mean)” indicates that the series in question converges in 
the mean to f. But since 


112 = [Ὁ = 25, 


[ςο5 kx||? = a cos” kx dx = π, 


sin kx||? = [Γ. sin? kx dx = π, 
(9-9) may be rewritten 
fx) = 5 ab. > (a, cos kx + by sin kx) (mean), (9-10) 
where a ᾿ 
ΕΝ : [ fx) cos kx dx, 


j (9-11) 


: f(x) sin kx dx, 


by, 


for all kK. This particular representation of fis known as its Fourier series expansion 
on the interval [—7, π], and the a; and δ are called the Fourier or Euler-Fourier 
coefficients of ἢ. 

Once again we emphasize that (9-10) must be read as asserting that the series 
in question converges in the mean to f, not that it converges pointwise in the sense 
that 


Χο) = 5 + > (a; cos Κχρ + δ. sin kxo) 
k=1 


for all x9 in [—7, 7]. Indeed, since the value of fat x9 can be changed arbitrarily 
without changing the value of its Fourier coefficients, this would be entirely too 
much to expect. Moreover, in view of Example 4 in Section 8-1, there is no 
a priori reason to expect that the Fourier series for f will converge to the value 
of fat so much as a single point in[—7, 7]. But, surprisingly, whenever fis reason- 
ably well-behaved, it converges to f(x) for all x. We shall have more to say on 
this point as soon as we have considered an example. 
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EXAMPLE 1. Find the Fourier series expansion of the function 


—1l, —-7r< x <0 
x) = 9 3 
πε. 


(see Fig. 9-8). 

In this case f is an odd function on [—7, π]. Hence so is f(x) cos kx, and 
(9-6) implies that a, = 0 for all k. On the other hand, f(x) sin kx is even, and 
we therefore have 


b, = 2 | sin kx dx 
πιο 


2 
= i, — cos kr) 


4 
Ee k = | See Paes Pane 


Ι 


0, Κπ-2,4,6,.... FIGURE 9-8 


Hence the Fourier series expansion of fis 


ee sin ἧς sn 2 Ἕ mos i | 


4 pas Ἐν sin we - De (9-2) 


(mean). 


In Fig. 9-9 we have sketched the graph of f and the sum of the first two terms 
of its Fourier series, which, as can be seen, already furnishes a fairly good ap- 
proximation to f throughout the interval [—7, 7]. This approximation improves 
considerably if we use the first four terms in the series (Fig. 9-10), and it is not 
difficult to see that it continues to improve as additional terms are considered. In 
so doing one quickly becomes convinced that the series actually converges point- 
wise to f everywhere in [-- π, x] where fis defined. Moreover, when x = 0 and 


sin 22) 


: sin3x , sin5x ΕἸ sin (1 


4Γ[. 
<|sin x + 3 + 5 7 


3 sin x + 
τ 


Ϊ 


FIGURE 9-9 FIGURE 9-10 
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+7, the series obviously converges to zero even though f is not defined at those 
points. Here then, in our very first example, we have come upon a Fourier series 
which converges pointwise in the interval [—~7, x], and which represents the func- 
tion from which it was derived at each point in the domain of that function. 

It would be easy to multiply the number of such examples indefinitely until the 
reader became convinced (erroneously, as it turns out) that all Fourier series con- 
verge at each point in the interval [—7, π]. Instead, however, we prefer to cite a 
theorem which will account for this phenomenon within the framework of the 
general theory of Fourier series. For the present we content ourselves with a 
Statement of the result in question, leaving any attempts at a proof to the next 
chapter. | 


Theorem 9-1. Let f be a piecewise smooth function in @C[—-x, x], by 
which we mean that f has a piecewise continuous first derivative on [--- π, π]. 
Then the Fourier series expansion for f converges pointwise everywhere in 
[--π, π], and has the value 


fxd) + S09) (9-13) 


at each point Χο in the interior of the interval, and 
ue - 
at Ἐπ. 


This theorem is one of the most important in the entire theory of Fourier series, 
and the student should make certain that he understands it thoroughly before 
going on. In particular, he should note that the expression 


fxd) + foo) 
2 


is none other than the average of the right- and left-hand limits of f at xo, and is 
equal to f(x9) whenever x9 is a point of continuity οἵ Hence the Fourier series 
expansion of a piecewise smooth function f in @C[—7, x] converges to f(Xo) when- 
ever XQ is a point of continuity of f. On the other hand, if fhas a jump discontinuity 
at Xo, (9-13) implies that the Fourier series for f converges at x9 to the value 
located at the midpoint of the jump, as shown in Fig. 9-11. 


Poe 


o Axo) +09) 


Xo FIGURE 9-11 
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When these results are applied to Example 1 above they allow us to assert that 
the series 


sin 3x sin 5x Ὁ | 


4]. δ 
4) sinx + , τς (9-15) 


converges pointwise in the interval [—7, 7] to 


—l1 if —-r<x <Q, 
0 if x = —7,0,7, 


Ι if 0 «χ «π. 


Thus, for example, when x = 7/2, the value of this series is 1, and we conclude 
that 


or 


Before continuing, it may be appropriate to remark that there exist continuous 
functions whose Fourier series diverge at finitely many points in [—7, x]. Thus 
the requirement that f have a piecewise continuous first derivative is imposed in 
order to guarantee the pointwise convergence of its Fourier series. Incidentally, 
the problem of determining whether there exists a continuous function whose 
Fourier series diverges everywhere in [—7, π] is still unsolved. Needless to say, 
such a function, if it exists, will be rather bizarre, and is not likely to arise in 
applications. 

By now the reader has undoubtedly observed that our description of the point- 
wise behavior of a Fourier series is incomplete. For if a trigonometric series 


a = . 
= ΞῈ dy (a, cos kx + b;, sin kx) (9-16) 


converges to the value Ky when x = Xp, it will also converge to Ko at all points 
of the form xg + 2zn, n an arbitrary integer. This, of course, is an immediate 
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FIGURE 9-12 


consequence of the fact that the functions sin kx and cos kx are periodic, with 27 
as a period, and allows us to make the following important observation: If (9-16) 
converges pointwise to a function f everywhere in [—7, 7), then it actually converges 
on the entire x-axis to the function F obtained by repeating f successively along the 
x-axis in intervals of length 2x (see Fig. 9-12). It is obvious that the function F 
obtained in this way is periodic with 27 as a period, in the sense that 


F(x + 29) = F(x) 


for all x. It is known as the periodic extension of f. 
When these remarks are combined with Theorem 9-1, they yield 


Theorem 9-2. The Fourier series expansion of a piecewise smooth function 
f in ΦΟΙ-- π, x] converges pointwise on the entire real line. Moreover, if F 
denotes the periodic extension of f, then the value of the series is (Χο) when 
Xo is a point of continuity of F, and 


F(xo) + F(xo) 
Z 


when Xp is a jump discontinuity of F. 


In particular, we note that the Fourier series for f will converge pointwise to a 
continuous function on the entire x-axis if and only if fis continuous on [—z7, 7] 
and f(—7) = f(r). For only then will F be free of jump discontinuities. We 
shall have occasion to use this fact later in the chapter. 

At the risk of belaboring the obvious, we point out that Theorem 9-2 can be 
used to sketch the graph of the Fourier series of any piecewise smooth function f 
in @C[—7z, z]. The procedure is as follows: First sketch the graph of the periodic 
extension F of f; then plot the midpoint of each jump discontinuity of F. The 
resulting picture, with these isolated points included, will be the graph of the series 
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FIGURE 9-13 


in question. Thus, for instance, the graph of the series 


4) sin. ge SIX τ | 
π 3 


found in. Example 1 appears as shown in Fig. 9-13. 


EXAMPLE 2. Find the Fourier series expansion of the function 
f(x) = |xl, -π <x «π, 
and sketch the graph of the series. | 
In this case f is an even function on [—7z, 7]. Hence 6; = 0 for all k, while, 


fork ¥ 0, 


es | x cos kx dx 

TJ0 

si sin kx ἀν] 
0 k Jo 


0 


_ 22 sin kx 
7 k 


Tv 


= ΞΕ cos kx 


2 
= τες (COS kr — 1) 


4 
Γ at! Rides τ 
0, k=2,4,6,.... 


Finally, when k = 0, we have 


τ 
2 
ay = -- xdx = x, 
0 


τ 
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σ΄ 


x 
25 


FIGURE 9-14 


and it follows that 


4 3 | ; 
|x| = A — 4 (cos x + = + rae εν ) (mean) 


in @C[—-, r]. The graph of this series is shown in Fig. 9-14, and, for comparison, 
we have sketched the graph of the sum of the first three terms of the series in 
Fig. 9-15. 


FIGURE 9-15 


EXAMPLE 3. Let g be the function in @C[—7, 1] defined by 


_ JO, —-r<x <0, 
gx) = |? 0 «χ «π. 


Then, with fas in Example 1, 
g= 314+ fl= ἐπ} 


and we conclude that the Fourier series expansion of g is 


Lb 2 ᾿ς sin3x , sin 5x 
542 (sinx + 3 = 5 te), 
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FIGURE 9-16 


The moral of this example is that a Fourier series can sometimes be found without 
recourse to integration. We refer the reader to Exercise 21 for a discussion of 
this technique, and to Fig. 9-16 for the graph of the series. 


EXERCISES 


In Exercises 1-10 find the Fourier series expansion of the given function. Sketch the 
graph of the series obtained, paying particular attention to its values at any points of 


discontinuity. 
1, —~<x<0 
1. f®) =x, —-weix<r 2. fe) τὸν oe 
3. f(y =e, —t<x< 4, f(x) = |sinx| 
—|x -- 3], —m<x< -} , ππκχκ« -ξὮ 
τ 0, ἀξ ας IONE Th, eee) 
x =-4, ξ x<t 35 “χίπ 
1. fix) = (« — xr + χ), 8. f(x) =e" -a<x<er 
—w<x< Tf 
_ jxtr —m<x<0 ae: 
2 fay = fET™ Oe we 10. f(x%) =x, -—-7<x<f 


11. 


(a) Sketch the graph of the Fourier series expansion of the function 


—1 —pliege oS Το 
᾿ 2 


τ τ 
7) = 1, εχ ας οἱ 
--ἰ Dee 
> 2 T, 


over the intervals [27, 37] and [— 27, 0]. 
(Ὁ) What is the value of the Fourier series for fwhen x = kz, k an integer? When 


x = (2k +1) τ 
k an integer ? 
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12. 


13. 


14. 


15. 


16. 
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(a) Sketch the graph of the Fourier series expansion of the function 
—1, ππ χ « -l, 
fi) = =? -1<x <1, 
1, 1 «χ «π, 


over the intervals [2π, 5π] and [--- 3π, —7]. 
(b) Find the value of the Fourier series for this function at the following points: 


x=1, x=7, x= -6, x =3, x= 7, x = --ὅτ. 


(a) Sketch the graph of the Fourier series expansion of the function 


2 
χ:π, ΞΡ ον 
2π 2π : 
f(x) = seem pe ee 
x; OS OS: τ’ 
τ τ 
ΣΝ τ Se 


(Ὁ) What is the value of the Fourier series for this function when x = kr, k an 
integer? When x = (4k + 1)(7/3), k an integer? 
(a) Find the Fourier series expansion of the function 


0, —-r<x <0, 
fx) =), 


x, ΕΞ χα < 2, 
and sketch the graph of the series obtained. 
(b) Use this series to show that 
Β΄ 
a 


(a) Find the Fourier series expansion of the function 


1 1 1 
ΤΟΣ gat gr 


0, —r~7<x<0 
x) = 3 -.Ξ- ν»» 
f(x) S Ole ee 


and sketch the graph of the series obtained. 
(b) Use this series to show that 


Find the Fourier series expansion of the function 


0 —7r<x<0 
(x) = [Ὁ : 
a COS X, Q<x <7, 


and sketch the graph of the series obtained. 


17. 


18. 


19, 


*20. 


21. 
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(a) Find the Fourier series expansion of the function 
f(x) = cosax, -π χ <7, 


for any real number a. 
(b) Use this series to prove that 


11 = 2a 
cotar = 21 - ard 


whenever a is not an integer. Justify the validity of your computations. 


A function f, defined and continuous at all but a finite number of points in any closed 
interval of the x-axis, is said to be periodic if there exists a real number p > 0 such 
that 


f(x + p) = 70) | 
for all x in the domain of f. The smallest positive real number p with this property 


(if such exists) is called the fundamental period of f; otherwise p is simply called a 
period. 


(a) Prove that if fis periodic with period p, then 
f(x + kp) = f(x) 


for all integral values of k. 


(b) Give an example of a periodic function which does not have a fundamental 
period. 


(c) Let fi and fe be periodic functions with fundamental periods p; and pg, respec- 
tively. Prove that aif; + a2f2 is periodic for every pair of real numbers a; and a2 
if and only if p1/p2 is a rational number. 

(4) Generalize the result in (c) to linear combinations of n periodic functions with 
fundamental periods pi, ..., Dn- 

Determine which of the following functions are periodic, and find the fundamental 
period of each if it has one. (See Exercise 18.) 


(a) sin (b) 2 sin 3x — cos 2x (c) tan x” 
(d) (sin 2x)(cos x) (e) sin (Ὁ tan 2x + 3 sin ax 


if x is rational 
if x is irrational 


φ) f(x) = ᾿ 
Let 


where P(x) and Q(x) are polynomials and Q(0) # 0. Prove that if fis periodic it is 
constant. [Hint: Let f(0) = a, and consider the equation P(x) — aQ(x) = 0.] 
Let 


ane > (a, cos kx + bd, sin kx) and Ao + > (4; cos kx + B, sin kx) 
2 k=1 2 k=1 
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be, respectively, the Fourier series expansions of the functions f and g in @C[—7, z]. 
Prove that the series 


ano 5 Pao + >) [oa, + BAx) cos kx + (ab, + BBy) sin Καὶ 
k=l 


is the Fourier series expansion of the function af +- 8g for any pair of real numbers 
a, B. 

22. Use Exercise 21 and the series found in Examples 1 and 2 and Exercise 1 above to 
‘obtain the Fourier series expansions of the functions shown in Fig. 9-17. 


FIGURE 9-17 


23. It can be shown that the series 


2k — 1 


and 


are, respectively, the Fourier series expansions of the functions 
0, —r~<x <0 x 
καὶ) = 4° ‘ and x)=-> ππ «χ «τπ. 
1, O< x «π, fale) v ss 


Use these series, and Exercise 21, to find the Fourier series expansion of each of the 
following functions. 


@ foy= | b “Tr <*<0 
—i, 0O<x<T 


x, O<x<T 


Lz, Ve; —7r< x <0 
a te + 27, 0O<x<T 


24. What is the Fourier series expansion of 2 + 7 cos 3x — 4sin 2x, considered as a 
function in @C[—7, 7]? 
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25. Without resorting to integration, find the Fourier series expansion of each of the 
following functions in @C[—7, 7]. 


(a) sin” x (b) sin x cos x 
(c) sin® x (d) sin x (cos? *) 
(e) cos 3x cos 2x (f) cos* x 


26. Show that Parseval’s equality assumes the form 
1 | ᾿ 2 αὖ “1 2 2 
~ | Πα => + 2d, (az + bi), 


with respect to the basis 1, cos x, sin x,...in @C[—7, π], where the a; and δὲ are 
the Fourier coefficients of αὶ 


27. (a) Find the Fourier series expansion of the function f(— x) in terms of the expansion 
of f(x). 
(b) Use the series found above, together with the appropriate result from Section 9-3 
to find the Fourier series expansions of fg and fo, the even and odd parts of αὶ 
(c) Under the assumption that the functions 1, cos x, sin x,...form a basis for 
@C[—-7, 7], use the results in (a) and (Ὁ) to find bases for the subspaces &[—7z, π] 
and O[—7, π] of @C[—7z, π]. 

28. Use the results in Exercise 27, together with Exercise 21 and the Fourier series 
expansion of e*, --π < x < 7a, to find the Fourier series expansions of sinh x and 
cosh x. 


*29. (a) Prove that the functions 1, cos x, sin x,..., cos kx, sin kx,...are orthogonal 
in @C[a, a + 27] for any real number a. 


(Ὁ) Under the assumption that the functions in (a) are a basis for @C[—7, 7], 
prove that they also form a basis for @C[a, a + 2] for any real number a. [Hint: 
Use Parseval’s equality.] 


9-5 SINE AND COSINE SERIES 


In the examples of the last section we took advantage of the fact that the functions 
considered were even or odd to simplify the task of finding their Fourier series ex- 
pansions. This technique can be exploited more often than one might expect, 
and is of sufficient importance to be brought out into the open. 

Specifically, if f is an even function in @C[—7, π], then, for all values of k, 
f(x) cos kx is even, and f(x) sin kx is odd. Thus, by (9-5) and (9-6), 


" f(x) cos kx dx = 2 [ " f(x) cos kx dx, 
-- τ 0 


[ , f(x) sin kx dx = 0, 


and it follows that the Fourier series expansion of an even function in ΦΘΙ-- π, 7] 
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involves only cosine terms and may be computed according to the formula 


fix) = > te Σ a,coskx (mean), (9-17) 
where . 
ay = Ξ Ι f(x) cos kx dx. (9-18) 


A similar argument shows that the Fourier series expansion of an odd function in 
ΦΟΙ ---π, π] involves only sine terms, and may be computed according to the formula 


f(x) = >> δι sinkx (mean), | (9-19) 
k=1 
where 
b, = 2 ἢ f(x) sin kx dx. (9-20) 
0 


Actually these results are more than mere formulas. For if we combine them 
with the fact that the functions 


1, cos x, sin x, cos 2x, sin 2x, .. 
are a basis for ΦΟΙ --- π, π], they imply, in turn, that 
1,cos x, cos 2x, ... 
is a basis for the space of piecewise continuous even functions on [-- π, 7], and that 
sin x, sin 2x, . 


is a basis for the space of piecewise continuous odd functions on [—7, 7]. Indeed, 
this is the import of the assertion that the series in (9-17) and (9-19) converge 
in the mean. 

In applications of the theory of Fourier series one frequently needs to obtain 
a series expansion for a piecewise continuous function f which is defined only on 
the interval [0, x]. One way of doing this is to extend f to the entire interval 
[—7z, 7] (where by this we mean that a function F is defined on [—7, x] in such 
a way that F coincides with f on [0, w]), and then expand Fas a Fourier series. In 
those cases where fis reasonably well-behaved, Theorem 9-1 guarantees that the 
Fourier series expansion of F will be a good approximation to fon [0, z]. 

The crux of this method concerns the manner in which fis extended to [—z7, z]. 
This, of course, can be done in any way whatsoever (so long as the resulting func- 
tion belongs to ΦΟΙ --π, 7]), but the following two extensions are the most con- 
venient and important. The first is the so-called even extension of f, denoted Ey, 


and defined by 
ae pe 0 


<x | 
fw. =.= x an 


AIA 


Ws, 
0, 
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while the second is the odd extension of f, denoted O;, and defined by 


= f(x), O<x< καὶ 
O;(x) = a on a _ (9-22) 


Figure 9-18 illustrates the even and odd extensions of a particular f, and furnishes 
visual evidence of the easily proved assertion that Ey is even and O; is odd for 
any f. This being the case, we can use Formulas (9-17) through (9-20) to obtain 
the Fourier series expansions of E; and O;. They are 


E;(x) = > + Σ) ας cos kx (mean), 
k=1 
ae (9-23) 
ας = -- | f(x) cos kx dx, 
το 
and 
O;(x) = >> δι sinkx (mean), 
k=1 
> [* (9-24) 
δ = 2 | f(x) sin kx dx. 
0 


These series are called, respectively, the Fourier cosine and Fourier sine series 
expansions of f, a mild misuse of terminology which rarely causes any misunder- 
standing. Unfortunately, the somewhat benighted term “half-range expansion” 
is also used in this context. 


E; : The even extension Oy; : The odd extension 
of f FIGURE 9-18 of f 
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As an example, we compute the Fourier cosine and sine series for the function 
f() = x74, 0 «χ «π. 
Here 
E;(x) = x7, —-41 <x <7, 


and integration by parts yields 
Σ᾽ 
a, = = x” cos kx dx 
πο 


= | x sin kx dx 
ak 0 


ee) cos kx dx| 
0 Ko 


= 4|- x cos kx 
= k 


= (-' k # 0. 


Finally, 


i 2 
w= 2f xa = 2, 


and we have 


᾿ 2 53 54 
E;(x) = = ~ 4 (cos « — ΠΣ 2 + a - “τς + -++}) (mean). 


To compute the series expansion of O; we use (9-24) with f(x) = x*. This gives 


ee 2 ΠΝ ΩΣ 
πτρ 


2 τ τ 
= 2 -- x" cos kx ny x cos kx ἀκ] 
ὄπ k 0 ko 
= 27 cos kar oe _ 1 fin kx dx 
—— k ka k 0 k Jo 
2n COS kr 4 7 
= τ νὰ 
2a cos kar 4 
= rg τ κα, (οδίπ - 1) 


2π ὃ 
pee Ke. 13. Shades 


—_ —— 3 k = 2,4,6,.... 
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τὰ 
--ῦπ —4y7r --Ξὃπ “--2}π -- π 7 2π 3π dr 5x 


FIGURE 9-19 


2π 3π 4π Sar 


== -- ἡ 


| 
| 
| 
| 
| 
| 
| 
| 


FIGURE 9-20 
Thus 


O;(x) = 27 (sin x - 


sin 2x sin 3x 
as 4 sind...) 


sin 3x sin 5x 


8/. 
~ 8(sinx + 33 + 53 ++) (mean). 


The graphs of these two series are shown in Figs. 9~19 and 9-20, respectively. 


EXERCISES 


1. (a) Find the even and odd extensions of each of the following functions in ®C[0, x], 
and sketch their graphs on the interval [—7z, π]. 


ὦ f(x) = 1 (li) f(x) = x? (δ f®%) =r -τἰ (iv) f(x) = ες 


(b) Sketch the graphs of the Fourier sine and cosine series for each of the functions 
in (a). 


354 


FOURIER SERIES | CHAP. 9 


. Let f be an arbitrary function in @C[0,#]. Prove that E; is an even function in 


GC[—7, 1], and that O; is odd. 


. Find the Fourier sine series expansion of the function 


f(x) =cosx, 0< x <7, 
and use this result to deduce that 


/ 24 1 3 5 7 


"Boa ἜΤΟΣ a 7 we Ξ 


16 253-11 BI ὌΝ 


. Find the Fourier cosine series expansion of the function 


f(x) = snx, O< x <7, 
and sketch the graph of this series. 


. Find the Fourier sine series expansion of e*,0 < x < 7m. 


6. Find the Fourier cosine series expansion of e7,0 < x < fm. 


10. 


11. 


12; 


13. 


. Find the Fourier sine series expansion of the function 


f@ =r7-—x, 0 «χ «π. 


. Let f be a function in @C[0, x] which is symmetric about the line x = 7/2. Show 


that the only nonzero terms in the Fourier sine series expansion of fare of the form 
B, sin kx, k odd, 


and find a formula for B,. 


. Let f be the function in @C[0, +] which is obtained by reflecting the function x?, 


0 < x < w/2, across the line x = 7/2. Use the results of Exercise 8 to find the 
Fourier sine series expansion of f. 
Find the Fourier sine series expansion of the function 


f(x) = x2 — rx, O< x «π. 
Let f be a function in @C[0, π] with the property that 


"( τ ἡ pie Ca), 0 «χ 9/2. 


Show that the only nonzero terms in the Fourier cosine series expansion of fare of 


the form 
A; cos kx, -k odd, 


and find a formula for Ax. 
Use the results of Exercise 11 to find the Fourier cosine series expansion of the 
function 
1, Ox < 4/2, 
OO = Ee m/2<x <7. 


Use the results of Exercise 11 to find the Fourier cosine series expansion of the 
function 


feo) = sin( -), 0O<x<n. 
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*14, (a) Prove that the functions 
sin x, sin 2x,...,sinkx,... 


form an orthogonal set in @C[0, 7]. 
(b) Use the fact that the functions 1, cos x, sin x, ... form a basis for @C[—z7, 7] 
to prove that the set of functions in (a) is a basis for @C[0, π]. 


(c) Prove that the functions 
1, cos x, cos 2x,... 


also form a basis for @C[0, π]. 


9-6 CHANGE OF INTERVAL 


Up to this point we have dealt exclusively with functions on the intervals [—7z, x] 
and [0, x]. For many purposes, however, this setting is too restrictive, and we 
now propose to generalize our results to an arbitrary interval [a, ὁ]. But rather 
than begin at once with the most general case, it will prove simpler if we first 
consider intervals of the form [—p, p] and their associated Euclidean spaces 
@C[—p, p]. For here the situation can be handled with dispatch. 

Indeed, it is all but obvious that the functions 


2πχ 


oe a ees ΝΝ (9-25) 
P p P 

are mutually orthogonal in @C[—p, p] (Exercise | below).* Moreover, just as in 
the case where p = π, it can be shown that these functions are a basis for this space, 
and hence that their associated orthogonal series (which, by the way, are still 
called Fourier series) converge in the mean. And finally, with due allowance being 
made for the length of the interval, all of our earlier remarks concerning pointwise 
convergence are valid in this setting. 

To obtain formulas for the Fourier coefficients of a function in ΦΟΙ--», p] 
we note that 


| ” dx = 2Ρ, 
—p 
and 

Dp Dp 

| Lee ee | LE eee Ρ. 

—p Dp —p P 

Thus, by Formula (8-22), 
f(x) = ᾿ + Σ; (α cos πα + b; sin hex (mean), (9-26) 
k=1 


* Actually, the entire issue comes down to making a change in scale on the x-axis by 
substituting 7x/p for x in the functions used earlier. 
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where ζ ἃ 


Dp 

Lf 
So —- dx, 
ar, pies F(x) cos Ρ x 


| » κ (9-27) 
δ, = -- | x) sin ἘΠῚ Fe 
r= 5) fe) sins 


for all k. And with this we are done. 

The above discussion can easily be adapted to handle the Euclidean space 
Cla, δ]. Indeed, if we set 2p = ὃ — a, so that [a,b] = [a, a + 2p], the func- 
tions in (9-25) are also a basis for @C[a, a + 2p]. This leads at once to the fol- 
lowing formulas for computing the Fourier series expansion of a function f in 
ΦΟ[α, 6]: 


fo) = 9 ὋΣ (a S38 Rae ἢν δ ἢ pee | (mean), (9.28) 
k=1 
where b 
a = > Ξ Ξ / f(x) cos pen dx, 
i (9-29) 
δι = 5 . Ξ | f(x) sin ἘΞ dx, 
for all k. 


EXAMPLE 1. Find the Fourier series expansion in @@[0,1] of the function 


f(x) = x. 
Here ὃ — a = 1, and (9-29) becomes 


Ι 


1 
a, = 2 [ x cos (2 Κπχ) dx, 


1 . 
δὰ. = 2 [ x sin (2Κπχ) dx. 


Integration by parts now yields 
ay = l, a, = 0, k ~ 0, δι = -- τ᾿ 


Hence 
sin 4rx sin 67x 


f(x) = ; -- * (sin 2πχ + 5 + ee +:- Ὶ (mean). 


The graph of this series is given in Fig. 9-21. 


--χ 


FIGURE 9-21 
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] 
| 
Ι 

4 


FIGURE 9-22 FIGURE 9-23 


EXAMPLE 2. Find the Fourier series expansion of the function f shown in 
Fig. 9-22. 
In this case, 


— x δὴ 
fx) = 1 
and Formulas (9-29) yield 


2s. 2 
χ, 3 


3 


AIA 


4 
a, = | f(x) cos Κπχ dx 
2 
3 4 
= [ (x -- 2) οο8 πχ dx + [ (4 -- x) cos Κπχ dx, 
2 3 
4 : 
by = [ f(x) sin Κπχ dx 
2 
3 4 ; 
= [ (x -- 2) sin Κπχ dx + [ (4 -- χ) 5.η Κπχ dx. 
2 8 


Although these integrals can be evaluated directly, the computations can be 
considerably simplified by invoking the following argument. 

Let F denote the periodic extension of f to the entire x-axis (Fig. 9-23). Then 
the functions F(x) cos krx and F(x) sin kxx are periodic with period 2, and we 
have 


a+2 4 

[ F(x) cos Κπχ dx = [ f(x) cos krx dx, 
‘ Ω (9-30) 
α- 2 ᾿ 4 ᾿ 

[ F(x) sin Κπχ dx = | f(x) sin krx dx, 
a 2 


for any real number a. [At this point we are using the obvious fact that if g is 
piecewise continuous on (— 0, oo) with period 2p, then 


a+2 b4+2p 
[ ° g(x) dx = i g(x) dx 
a b 
for any pair of real numbers a, b.] We now set a = —1 in (9-30) to obtain 
1 
a, = [ F(x) cos Κπχ dx, 
af 


1 . 
δι = [ ᾿ F(x) sin krx dx. 
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But on the interval [—1, 1], F coincides with the even function |x|. Hence 5, = 0 
for all k, and a, = 2f, xcoskmxdx. Thus 


k odd, 


ao = Ι, ay = k2a2 
0, keven, k € 0, 


and the Fourier series expansion of fis 


cos 37x cos 51x 


fx) = ; - 4 (cos aX + 32 + 52 a δον Ὶ (mean). 


The student will find this technique useful in some of the following exercises. 


EXERCISES 


1. Prove that the functions 


Κπχ 


9 oe @ 


x ° 
> Sin 


WX . WX kr 
1, cos — > sin-——»> τ᾽ 008 
Pp Pp 


are mutually orthogonal in @C[—p, p]. 


2. Let f be piecewise continuous and periodic on the entire x-axis, and suppose that f 
has period 2p. Prove that 


i ” fo dx = | oT"? 6x) dx 
b 


a 


for any pair of real numbers a, ὃ. 
3. Find the Fourier series expansion of the function in @C[—2, 2] defined by 


0, —2<x < —l, 
f(x) =4 |x|, -1 <x <1, 
0, 1 <x 2, 


Sketch the graph of the series. 
4. Find the Fourier series expansion of the function in @C[1, 3] defined by 


2 -- χ, Vim KR Ze 
xXx) = 
7 ὑπο: ἘΞ per 


5. Find the Fourier series expansion of sin x as a function in @C[0, 7/2], and sketch 
the graph of the series. 

6. Find the Fourier series expansion of cos x as a function in @C[r/2, 34/2], and sketch 
the graph of the series. 

7. Find the Fourier series expansion of the function 


1, 8B<x <9, 
Xj => 
75) π᾿, 


10. 


12. 


13. 


14͵ 
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. Find the Fourier series expansion of the function 


1, 2 Xe KS 
4 -- χ, 3<x « 4, 
χ-- 4, 4<x <5, 
1, 5 «χ « 6. 


f(x) = 


. Find a Fourier series which contains only sine terms and which converges pointwise 


to the function x — 1 for1 < x < 2. 


Find a Fourier series which contains only cosine terms and which converges point- 
wise to the function x — 1 for1 < x < 2. 


. Find a Fourier series which contains only sine terms of odd “degree” and which 


converges pointwise to the function x? — 4 when2 < x < 3. [Hint: See Exercise 
8, Section 9--5.] 


Let f be a piecewise continuous function of period 27 defined on the entire x-axis, 
and suppose that the Fourier series expansion of f is 

a οὐ 

stl + Σ) (a, cos kx + δι sin kx). 

2 κε 


Let the Fourier series expansion of f(x + 7) be 


Ao ΞῈ » (A, cos kx + B, sin kx). 
2 k=1 


Show that 
Ay = (—1)'a, 
and 
By, = (—1)*by. 
Given that the Fourier series expansion of x, —r < x < 7m, 1S 
2] sin sin2x | sin3x oe 
7 2 3 


use Exercise 12 to find the Fourier series expansion of the function 


x+am,—-—-—m7T<x < 0, 

x— π, O0< x «π. 

Let f be piecewise continuous on (— ©, ©), and assume that f(x + 7) = —/f(x) 
for all x where fis defined. 

(a) Prove that fis periodic with period 27. 

(Ὁ) Show that the Fourier series for f has only odd terms. 


(c) Prove, conversely, that f(x) = —f(x + πὴ whenever the Fourier series for f 
has only terms of odd degree. 


᾿ (6) What can be said about a function whose Fourier series contains only even 


terms? Why ts this situation not particularly interesting ? 


Remark: Functions satisfying f(x) = —f(x + 7) on (—©, ©) are said to possess 
half-wave symmetry and are of interest in electrical engineering. 
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*9-7 THE BASIS THEOREM{ 


We have already had occasion to remark that the entire theory of Fourier series 
ultimately rests upon the fact that the set of functions 


1, cos x, sinx, ..., coskx, sinkx, ... 


is a basis for the Euclidean space @C[—7, x]. As we shall see, this result can be 
made to depend upon one of the really fundamental] theorems in analysis, the 
famous Weierstrass Approximation Theorem. This theorem, whose proof will 
be given in Section 10-8, is usually stated in one of two equivalent forms, the 
first of which involves trigonometric polynomials, the second ordinary polynomials. 
For our present purposes the statement involving trigonometric polynomials is 
the more appropriate. 


Theorem 9-3. (Weierstrass Approximation Theorem.) Let f be a con- 
tinuous function on the interval [—7z, x], and suppose that f(—7) = f(x). 
Then, given any real number € > 0, there exists a trigonometric polynomial 


N(e€) 
T(x) = 49 + >) (Axcos kx + Βι sin kx) 
k=1 
such that 


Τοῦ — fol «ε 


for every x in[—7, π]. 


Descriptively, this theorem asserts that the graph of T(x) lies between the graphs 
of f + ε and f — ε throughout the entire interval [—7, π], as illustrated in Fig. 
9-24. The notation NM(e) in the formula for T(x) is a reflection of the fact that in 
general the number of terms in this trigo- 
nometric polynomial will depend upon e, 
increasing as e becomes small. 

Theorem 9-3 is often stated in the fol- 


\ 


lowing terms: “Any continuous periodic dh x) ἃ 
function can be uniformly approximated by KT) | 


trigonometric polynomials,’ phraseology 
which requires some explanation. In the 
first place, we have already observed that 
any function fin @C[—7, a] can be ex- 
tended to the entire real line in such a 
way that the extended function is peri- 
odic. Now if fhappens to be continuous 
and if f(—7) = f(n), it is clear that the FIGURE 9-24 


͵τγτττς------ 


+ The discussion in this section uses the notion of a closed subspace defined in Sec- 
tion 8-5. 
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periodic extension F of f will be continuous on the whole real line (Fig. 9-25). It 
follows that a trigonometric polynomial which approximates such a function 
everywhere in [—7, 7] will actually approximate the periodic extension of f. This 
accounts for the term “‘periodic” in the above statement. 


FIGURE 9-25 


As far as the word “uniform” is concerned, it wiJ] suffice for now to remark 
that it 15 used to call attention to the fact that the approximation of f by T holds 
for all x in the interval [—7z, π]. 

We are now ready to prove that the set 1, cos x, sin x,..., which we shall 
denote by ®, is a basis for @C[—7z, 7]. To do so we introduce the subspace 
O[—7, π] consisting of all continuous functions in @C[—7, 7] which satisfy the 
equation f(—7) = f(r), and establish two preliminary results concerning this 
subspace. The first is 


Theorem 9-4. Every function in Φί ---π, x] belongs to 8(B), the closure 
of ὦ in ΦΟΙ --- π, πΊ. 


Proof. Recall that $(@) is, by definition, the subspace of ΦΟΙ .-- π, π] consisting 
of those functions which belong to S(®) or are limits in the mean of sequences of 
functions in 8(®), or both.* Thus to prove the theorem we must show that every 
f in Φί --π, 7] can be approximated arbitrarily closely in the mean by a trigono- 
metric polynomial. 

To accomplish this we apply the approximation theorem and, for each integer 
k > 0, find a trigonometric polynomial 7, such that 


Ι 


Tex) -- ΠΟ] < 9 


for all x in [—7z, x]. Then 


7; — fll = ([- [Ti(x) -- (ΟἹ dx) ᾿ 


᾿ (|. oe) 


a) 


* $(@) is, of course, the set of a// trigonometric polynomials. 
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It follows at once that the sequence {7;},k = 1,2,..., 850 obtained, converges 
in the mean to f, and the theorem 15 proved. J 


The second result is as follows: 


Theorem 9-5. Given any real number ε > 0, and any f in @C[—n7, π], 
there exists a function g in @[—7, π] such that 


If — gll <e. 


In other words, any function in ΦΟΙ --- π, 7] can be approximated arbitrarily 
closely in the mean by a function in O[—7, π]. 


FIGURE 9-26 


Proof. The function g is constructed from f by “mending the discontinuities” of 
fas suggested in Fig. 9-26. Specifically, suppose that fis a function in @C[—z, 7] 
which has a single jump discontinuity at xo. In this case, g is the continuous func- 
tion obtained by redefining f near —z, xo, and as shown by the broken lines 
in Fig. 9-26. (Note that this has been done in such a way that g(—7) = 5(π), so 
that g does indeed belong to @[—7, π].) 

Calculating || f — g||* we find that 


Lf — all? = [ LAG) — «οὐδ dx 
= [νῷ - οὐ + [ἢ νῷ — aor ae 
+ f° Uf) — gf ax, 


since f(x) = g(x) whenever x belongs to the intervals [—a + 6, Χο — ὃ] and 
[xo + 6,” — ὃ]. Now let M be an upper bound for |f(x)|.on [—7, 7]; Le., 
|f(x)| < M for all x in [—z, x]. Then |f(x) — g(x)|? < (2M)? everywhere on 
[—7, 7], and it follows that 


lf — gil? < 4Μ3(ὃ + 25 + 8) = 16M76. 


To make this quantity less than any preassigned € > 0, it obviously suffices to 
choose ὃ < €/16M?. Thus the theorem holds for functions with a single dis- 
continuity. To give the proof for any fin @C[—r, 7] just repeat this process at 
each point of discontinuity. ἢ 
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Before stating the basis theorem, let us pause a moment to take stock of the 
situation. The preceding result tells us that any function in @C[—7, π] can be 
approximated arbitrarily closely in the mean by a function in @[—7, 7]. But 
Theorem 9-4 asserts that every function in 6] -- π, 7] can in turn be approximated 
arbitrarily closely in the mean by a trigonometric polynomial. Taken together 
these two statements ought to yield a proof of the fact that @ is a basis for 
ΦΟΙ ---π, x]. They do, in the following manner. 


Theorem 9-6. ὦ is a basis for 0C[—7, x]. 


Proof. We must show that every fin @C[—7, π] is the limit of a sequence of 
trigonometric polynomials. But, by Theorem 9-5 we can find functions ff, in 
ΘΙ --π, π] such that 


| 
If - fll “κ᾽ k = yD ideas 
while by Theorem 9-4 we can find trigonometric polynomials Τὰ such that 


fi -- Tul] < a 
Hence, by the triangle inequality, 
If — Tell = | — fe) + Se — ΤΩ] 


«[|[},. -- All + Wh — Tall 
Me vp. aM, et, 


and it follows that the sequence {7;,} converges in the mean tof. J 


For later purposes we also record the following easy consequence of the basis 
theorem: 


Corollary 9-1. (Parseval’s Equality.) Jf fis any function in ΦΟΙΪ --- π, π], 
then 


πτ 9 ΓΞ 
1. γα - 2+ Ya + δ), (9-31) 
= k=1 


where the a; and δὲ are the Fourier coefficients of f. 


Proof. Since the functions 1, cos x, sin x,... area basis for @C[—7, 7], Parseval’s 
equality is satisfied, and we have 


in? - : 2 ΠΣ oe (f+ sin = (9-32) 
k=1 


|| lcos kx]|? [51η kx||2 
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(Formula 8-21). But 
σὴ _— Sie fax? ταῦ 


[1 ||? 2π 2 
(f-coskx)? — (f_,flx)coskx ας 0 
ἴσος kx|2 τ ὅν He 
(f:sinkx)? ([ «0 ) 8ιπ κα αὐ _ 1. 
‘snk? σςὦοὸ τοὸὕς τ» 


and (9-31) now follows at once from (9-32). J 


9-8 ORTHOGONAL SERIES IN TWO VARIABLES 


With an eye to later applications we now sketch the theory of series expansions 
for functions of two variables. A corresponding theory also exists for functions 
of any finite number of variables, but since we shall have no occasion to use these 
results their formulation is left to the reader. 

Our first task, of course, is to define a function space in which to conduct the 
discussion. This is accomplished by generalizing the notion of piecewise continuity 
to accommodate functions of two variables, and then using these functions to 
construct the two-dimensional analog of the space @C[a, δ], as follows. 

A function f is said to be piecewise continuous on a rectarigle R in the plane if 

(i) f is continuous everywhere in and on the boundary of R, with the possible 
exception of a finite number of points, or along a finite number of simple differ- 
entiable arcs, or both;* and 

(ii) lim(z,y)(zg,y9) L(x, Y) exists whenever (Xo, Yo) is a point of discontinuity 
of f and (x, y) approaches (x9, yo) from the interior of any one of the regions into 
which R is separated by the arcs of discontinuity. 

Any function which is continuous in and on the boundary of R is piecewise con- 
tinuous, so that, in particular, such functions as sin (mx) sin (wy), sin (mx) cos (ny), 
etc., m and n integers, are piecewise continuous on any rectangle in the plane. 
However, the set of piecewise continuous functions is clearly larger than the set 
of continuous functions for any rectangle R. In Fig. 9-27 we have illustrated a 
rather general piecewise continuous function, in order to dispel any doubts about 
the nature of such functions. We also remark that it is quite legitimate to consider 
piecewise continuous functions in regions other than rectangles. The basic defini- 
tion remains unchanged, except that we replace R by a region whose boundary 


* A plane curve 
x = x(t) 
y = vy) 


is said to be a differentiable arc if the functions x(t), γ( have continuous derivatives with 
respect to 1. A differentiable arc which does not intersect itself is said to be simple. 


0<r<1, 
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consists of a finite number of simple differentiable arcs. This not withstanding, 
we shall restrict our attention to rectangular regions throughout this section. The 
reasons behind this prejudice in favor of rectangles will become apparent as 
soon as we state Theorem 9-7. 


FIGURE 9-27 


As with functions of a single variable, we agree to identify two piecewise con- 
tinuous functions whenever they agree everywhere in R except at their points of 
discontinuity. This done, the totality of piecewise continuous functions on R 
becomes a Euclidean space under the usual operations of addition and scalar 
multiplication, and the integral inner product 


fg = {{ fx vg») aR. (9-33) 
κε 


(The student will recall that when R is the rectangle a< x<b,c<y<d, 
this double integral may be evaluated by computing either one of the iterated 
integrals 


[, [ Pes noes ») ὦ dx or Ι “ [ “Κα, yglx, y) dx dy.) 


We shall denote the resulting Euclidean space by @C(R). 

Our next task is to find a basis for PC(R). And here the fact that R is a rectangle 
becomes important, for we can then reduce this problem to that of finding a basis 
for a Euclidean space of the type @C[a, δ]. This is the content of 


Theorem 9-7. Let {f;(x)} and {g,;(y)} be orthogonal bases for the Euclid- 
ean spaces @C[a, δ] and @C[c, d], respectively. Then the set of all products 


{filx)g;0)}, Ϊ τΞ l, 2; δι Ἐπὶ ὁ J = l, 2, a | (9-34) 
is a basis for @C(R), where Καὶ is the rectanglea< x<be<y<d. 
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The proof of this theorem is given below, following the examples. First, however, 
we observe that the generalized Fourier coefficients of any function Fin @C(R), 
computed with respect to the functions in (9-34), are 


ee es (figi) : 
= (figi)° (f:2;) 


or, in greater detail, 


[[ FG Figs) aR 
R 


Gf = = ΞΕ θαξ εν ξ 5 πες (9-35) 
(ποῦ ει} aR 
R 
Thus the series expansion of F can be written as a double series 
DD aifigi), (9-36) 


i,j=l 

and Theorem 9-7 allows us to assert that this series converges in the mean to F. 
(The order of summation in such a series is a matter of indifference since the 
assertion that the functions f;g; are a basis for ®C(R) is not affected by the order 
in which they are displayed.) 


EXAMPLE 1. Let R be the rectangle —t < x < 7, —t < y 3 τ. Then the 
set of functions 


sin mx sin ny, sin mx COS qy, (9-37) 
cos px sin ny, COS px COS gy, 
where m and n range independently over the integers 1,2,..., and p and q over 


the integers 0, 1, 2,..., is a basis for PC(R). More generally, the set of functions 


εἰ Ππχ. Ary . qry 
b b 
2 ᾿ Ε (9-38) 
co al a), cos "τὶ Cos any 
a b a b 


is a basis for the Euclidean space of piecewise continuous functions on the 
rectangle —a <x <a,—-b<y<b. 


EXAMPLE 2. Find the series expansion of the function 
F(x, y) = xy 


in the rectangle —r < x < a, --π < y < π relative to the basis given in the 
preceding example. 
Here we must evaluate the coefficients 


Omns Amq Apns %pq 
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of Formula (9-35) for the various functions in (9-37) and the given function F. 
But since x cos px and y cos qy are odd functions of x and y, 


τ 


a (x cos px)(y sin ny) dx dy = 0, 


--τ --π 


fe [ (x cos px)(y cos 4») dx dy = 0, 
[ “ [ ' (x sin nx)(y cos gy) dx dy = 0. 


Thus all of the Fourier coefficients of F except the a», are zero. To evaluate them 
we note that 


OD ited ᾿ 2 
[ sin“ mx dx = [ cos nydy -Ξ π 
--χκ --τ 


for all positive values οἵ m and n. Hence 


ae [- xy sin mx sin ny dx dy 
Amn ey τοῖς ae τον τ ee 
f_, [—» sin? mx cos? ny dx dy 
ae x sin mx dx | y sin ny dy 
τ --π --π 


i, 


4, x sin mx de | y sin ny dy. 
π΄ J0 0 


But 


| tsinktdt = (—1)*+! 2; 
0 k 


4 m τ n Tv 
amn = ΠΕ: ες τ (0 ἰὼ τ᾿ 


and it follows that 


πΞ2 
4 
=(-1"" 
mn 
Thus 
Ν : , 51η Χ 812} sin2xsiny 
xy = 4| sin x sin y ἜΝ 5.1 
4. Sin x sin 3y sin2xsin2y , sn3xsiny 
1-3 232 3-1 
- πο κι aym4n SiN mx sin ἥν 
pee " ΠΗ 


Series of this sort are called double Fourier series, and, as we shall see, arise in the 
study of boundary value problems involving partial differential equations. 

We now return to the proof of Theorem 9-7. For the sake of simplicity we shall 
assume that {f{(x)} and {g;(y)} are orthonormal bases for @C[a, δ] and @C[c, d]. 
As we know, this involves no loss of generality since an orthogonal set can always 
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be normalized in the usual fashion. In this case the set of products {f,(x)g;()} 
is also orthonormal, and hence, of course, orthogonal, as asserted in the theorem. 
We leave the task of establishing this fact as an easy exercise, and turn to the 
problem of proving that these functions are a basis for @C(R). 

By Theorem 8-3 we know that the set {f;(x)g;(y)} will be a basis if and only 
if it satisfies Parseval’s equality. Thus it suffices to prove that 


| [re yy? dR = > αἴ; (9-39) 
R 


1,j=1 


for any function Fin @C(R). 

We first consider the case in which F is continuous everywhere in R. Then, 
for each value of y in the interval [c, d], F(x, y) is a continuous function of x, 
and as such can be viewed as a member of ΦΟ[α, δ]. But then we can apply Parse- 
val’s equality to it and the basis {f;(x)} to obtain 


b 
| F(x, yy" dx = D7 (F- fi” 
i i=l 


y Ι "Fle fd) ax 


t=1 


Moreover, each of the integrals appearing in this equality is a continuous function 
of y. For convenience of notation we now set 


b 
h{y) = ] F(x, γ)7.(Χ) dx, 


and rewrite the above equality as 


ὃ [ea] 
| F(x, »)" dx = > AW’. (9-40) 


w=! 


We now call upon the result from the theory of infinite series which says that a 
series of positive continuous functions which converges pointwise on a closed 
interval to a continuous function may be integrated term-by-term.* Thus, inte- 
grating (9-40), we obtain 


[ [ F(x, y)” dx dy = Sf hy)’ ay). (9-41) 


* This result is a consequence of Dini’s Theorem (see R. Courant, Calculus I, Inter- 
science, New York) which guarantees that such a series is uniformly convergent and 
can be integrated term-by-term. (See Appendix I.) 
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But since {g;(y)} is a basis for @C[c, d], Parseval’s equality implies that 


d 
᾿ hy)? dy = > (hi gi) 


j 


->| : ΑΘ)» 4]: 


7ΞΞῚ 


for each integer i. If we substitute these values in (9-41), and recall the definition 
of h,(y), we find that 


[fees γ)" dR 


I 
Ms 


>a [i hires) ay 


i=1 j=1 


2 


d pb 
Π I F(x, y) filx)gi(y) dx ay] 


Thus (9-39) holds, and the proof is complete in the case where F is continuous. 

The proof when F is piecewise continuous, but not continuous, requires a more 
sophisticated version of the ‘“‘mending of discontinuities’ theorem of Section 9-7 
to show that F can be approximated arbitrarily closely in the mean by a continuous 
function. Although the procedure necessary to prove this result is conceptually 
clear, its details are both complicated and unenlightening, and we therefore omit 
the argument. But once this fact has been accepted, the general conclusion follows 
from the continuous case proved above. J 


As might be expected, questions concerning the pointwise convergence of 
double series are rather difficult, and particular orthogonal systems must be con- 
sidered individually. However, we can state one theorem which, though somewhat 
restricted in scope, is sufficient to answer all such questions that arise in this book. 


Theorem 9-8. Let Καὶ be the rectangle --π < x < xr, --π < γ < a, and 
suppose that F is continuous on R, and that 


OF oF 07°F 
and 
Ox Oy Ox ὃν 


exist and are bounded everywhere in R. Then the double Fourier series for F 
converges pointwise to F everywhere in R.* 


With obvious modifications this theorem remains true for any rectangle. 


* See E. W. Hobson, The Theory of Functions of a Real Variable, Second Ed., Cam- 
bridge University Press, 1921, 1926. 
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EXERCISES 


1. (a) Verify that the set of functions {f;(x)g;(y)} of Theorem 9-7 is orthogonal in 
@C(R), and that this set is orthonormal whenever {f;(x)} and {g;(y)} are ortho- 
normal. 

(Ὁ) Find the norms of these functions in terms of the norms of the functions f;(x) and 
4:0); i.e., find a formula for ||fi(x)g,(»)|| in terms of ||f()|| and ||gi(7)]). 

2. What are the norms of the functions in (9-37)? In (9-38)? 

3. What is the form of the double Fourier series expansion of a function Fif F(—x, y) = 
F(x, y) and F(x, —y) = F(x, y)? If F(—x, y) = —F(x, y) and FQ, —y) = —F(x, y)? 

4. (a) Repeat Exercise 3 for a function F such that 

F(—x,y) = F(x,y) and F(x, —y) = —F(x, y). 
(b) Repeat Exercise 3 for a function F such that 
F(—x, y) = —F(x, y) and F(x, —y) = F(x, y). 
In each of the following exercises find the double Fourier series expansion of the given 
function in PC(R); R the rectangle --π < x < a7, --π Sy <T. 

5. F(x, y) = x 

6. F(x, y) the function which is 1 when x and y are both positive or both negative, and 
—1 otherwise. 

7. F(x, y) = sin? (x + y) 8. F(x, y) = οἷν 

9. F(x, y) = xy? 10. F(x, y) = |x| 


10 


convergence of fourier series* 


10-1 INTRODUCTION 


In this chapter we shall investigate some of the convergence problems which 
arise in the study of Fourier series. Our first efforts will be devoted to proving 
the theorem cited in Section 9-4 describing the pointwise behavior of the Fourier 
series for a piecewise smooth periodic function. Once this has been done, we 
shall consider the more delicate (and interesting) problem of uniform conver- 
gence, and the related questions of term-by-term differentiability and integra- 
bility of Fourier series. Finally, we shall introduce the important notion of ‘‘sum- 
mability”’ for infinite series, and use it to extend these results to arbitrary functions 
in @C[—z, 7]. Throughout this discussion we shall assume that the reader is 
familiar with the notion of uniform convergence, and the results contained in 
Sections I-3 and I-4 of Appendix J. They will be essential in all that follows. 


10-2 THE RIEMANN-LEBESGUE LEMMA 


We begin the formal work of this chapter by establishing a result which, in addi- 
tion to being essential for the proof of our first convergence theorem, is also of 
considerable interest in itself. 


Lemma 10-1. (The Riemann-Lebesgue lemma.) If g is piecewise continuous 
on [a, b], then 


lim f eC Ona =i [ “οὐ οι ἘΞ 0. (0-1) 
+o Ja A> 0 Ja 


The reader should note that (10-1) has already been established when \ -- οὐ 
through the values 2πκ, (ὦ — a), k = 1,2,... (see Corollary 8-1). The burden 
of the present assertion is that this result is still valid as \ tends continuously to 
infinity. Intuitively, of course, this is reasonable, since the positive and negative 
portions of the area under each of the curves g(x) sin \x and g(x) cos Ax tend to 
cancel one another as ἃ > oo. 


* This chapter may be omitted in its entirety without loss of continuity. 
371 
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Proof. Since the argument is similar for both functions we shall give the proof 
only for g(x) sin Ax. Here if 


b 
IQ) = [ g(x) sin (Ax) dx, (10-2) 
and if ¢€ > 0 is given, we must show that there exists a constant \ such that 


10}}}] « € for all \ > Xo. To this end we assume for the moment that g is con- 
tinuous, and make the substitution x = ἐ + (/d) in (10-2) to obtain 


b—x/X 
10) = -- | g (: ae *) sin (Xf) dt, 
elk λ 


or, reverting to the variable x, 


b—x/X 
IA) = -- | g (- + =) sin (Ax) dx. (10-3) 


--π Ιλ 


Adding (10-2) and (10-3), we find that 


a b 
21) = -- | g (- + =) sin (Ax) dx + / “5 g(x) sin (Ax) dx 


--π Ιλ 


ὑ--π|ὰ 
+ | | 2) — g (= + τ sin (Ax) dx. 


Hence if M denotes the maximum value of the function |g| on [a, b], and if #/A < 
b — a (which, of course, we may assume), then 


a b 
21} < uf |sin Ax| dx + uf π |sin \x| dx 
a—7/X --.ὲἨ( 


b—w/X 
d 


< 2M b—x/X 
2Mn Ι 


(recall that {sin \x| < 1 for all x). Thus 


|sin Ax| dx 


g(x) — a(x + =) 


g(x) — a(x ἘΣ r) 
g(x) — a(x + τ) 


To complete the proof in the case under consideration we now use the fact that 
g is uniformly continuous on [a, δ] to find a constant \o such that 


50) - a(x ἘΞ) < p23 


dx 


b—a/X 
dx. 


Wool < 47 + 5 +i 
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for all » Ao, and all x in [a, δ]. In addition, we suppose that λρ is chosen 
so that, at the same time, Mx/\ < ¢€/2 whenever ἃ > Ao. Then 


IO) <5 +5 = € 


for all X > Xo, as required. Finally, to establish the assertion for an arbitrary 
function in @C[a, δ], we merely apply the above argument to each of its con- 
tinuous pieces. J 


10-3 POINTWISE CONVERGENCE OF FOURIER SERIES 


In this section we use the Riemann-Lebesgue lemma to establish our first con- 
vergence theorem. The main step in the proof consists of deriving a formula for 
the partial sums of an arbitrary Fourier series 


ao = : 
5 + du (a, cos kx + δ sin kx), 


where 


κ τ 


a, = 1 (x) cos kx dx, δὰ = 1 f(x) sin kx ἄχ, 


and fis any function in @C[—7z, π]. The derivation goes as follows. 
Let 


Sr(x) = > + >» (a; cos kx + 6b; sin kx). 
k=1 


Then 
5,0) = σὲ [. fit) dt 
+ 5 3 cos (kx) | S(t) cos kt dt + sin (kx) | JS(® sin kt a 
k=1 Ξ δε 


= 1 Ἕ I 3 + du (cos kx cos kt + sin kx sin Kn] dt 


1 [° Db apse 
- [ f(t) Ε + » cos k(t — »| dt. 
But by summing the trigonometric identity 


sin (k + 4)s — sin(k — 4)s = 2 sin 5 cos ks 


* Recall that a continuous function on a closed interval is uniformly continuous. 
(Theorem I-13, Appendix I.) 


374 CONVERGENCE OF FOURIER SERIES | CHAP. 10 


as k runs from 1 to n, we find that 


: ie Ge ar aes, 
sin (n + 3)s sin 5 uP 


Or 


No 


ul _ sin(a + $)s 
toa CONS aga en) 


Hence 


sin sin (n + 5)({ — x) + 3) — x) 
Sn(x) = Lf JOG = ΤΗΝ 2 sin(t — x)/2 a 


We now regard x as fixed, and make the change of variable s = t — x, to obtain 
_ 1 = sin (n + 4)s 
Sn(x) = ΤΙΝ LO 5 in py ὰ 


Finally, if we now assume that f is periodic on (— 00, 00) with period 27 (ie., if 
we replace f by its periodic extension to the entire real line), then S,,(x) is also 
periodic with period 27 (Exercise 9), and we can write 


Sie 1 [ eee eR as. (10-5) 


This is the desired result, which is known as Dirichlet’s formula for S,. Moreover, 
for future reference, we also note that when (10-4) is integrated from —z to 7, 


we have ᾿ 
sin (n + 3)s us 
[ 2 sin 2). ds = π. (10-6) 


Now that these facts have been established we can easily prove 


Theorem 10-1. Let f be piecewise continuous on (— 2%, «), with period 2r, 
and suppose that f(x) = sLf (xt) + f(x_)] for all x. Then the Fourier 
series expansion for f converges to f(Xo) at each point x9 where f has a 
right- and left-hand derivative. In particular, if f is piecewise smooth its 
Fourier series converges to f(x) for all x.* 


* To accommodate points xo where f has a jump discontinuity, we define the right- 
and left-hand derivatives of f to be, respectively, 


+ 
ing 2 TOO). πᾷ 


h—-Ot h ae 


provided these limits exist. The reader should note that these definitions reduce to the 
usual ones at those points where f is continuous. Moreover, if both of these limits exist 
and are equal and if xo is a point of continuity of f, then fis differentiable at xo, and the 
value of its derivative is the common value of the above limits. Finally, we recall that a 
function is said to be piecewise smooth if it has a piecewise continuous first derivative. 


f(xo — — fo) 
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Proof. We begin by considering the case where xo is a point of continuity of Καὶ 
Then f(x{) = f(x>) = f(Xo), and the assumption that f has a right- and left- 
hand derivative at xo requires that both of the limits 


im 7 6 Ὁ ἢ) -- χ0) ang ἢ 70 -- = - flxo) 


hot h a ae 


exist. We must show that the difference S,(xo) — f(xo) tends to zero with 
increasing n. (Here, as always, S, denotes the nth partial sum of the Fourier 
series for 7)). 

Now by (10-5) and (10-6), 


1 [" sin (n + $)s 
tf LOOT τ ΤΡ 


sin (1 + 2)s 5 
at]. I(%0 ) J sin (5/2) 2 sin (s/2) i 


1 [ [πο + 5) -- foro EEE as 


= τ [feo to = feo) ἧς | sin (n + 5)s ds. 


π 5S sin 5 


Sr(xo) — f(xo) 


I 


Moreover, since f has both a right- and left-hand derivative at xo, the function 


_ fo + 5) — fo) ὁ: Ξ 
g(s) = ς nae (10-7) 
is plecewise continuous on [—7, π] (see Exercise 1). Hence by the Riemann- 
Lebesgue lemma, lim,_,..[S,(x09) — f(o0)] = 0, as required. 
To complete the proof it remains to treat the case where χρ is a point of dis- 
continuity of f. Here we must show that the series 


5 + Σ᾽ (aq cos kxo + by sin kxo), 


k=1 


where a;, and δὲ are the Fourier coefficients of f, converges to f(xo) = 3{f(x¢) + 
f(xo)]. But this is equivalent to showing that the Fourier series expansion of 
the function 


G(x) = f(x + x0) — (0) 


converges to zero at x = O (see Exercise 4). To do so we decompose G into its 
even and odd parts as 
G = Gz + Go, 


and observe that the Fourier series for Go converges to zero at x = 0. Hence it 
is sufficient to prove that the same is true of the Fourier series for Gz. However, 
it follows at once from the definition of G that Gg is continuous at x = 0, and 
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has a right- and left-hand derivative there (see Exercise 4). Thus, by the continuous 
case treated above, the Fourier series for Gg converges to 3[Gz(0*) + Gz(0-)] = 
Gr(0) = 0. From this we conclude that the Fourier series for G, which is just 
the sum of the corresponding series for Gg and Go, converges to zero at x = 0, 
and the proof is complete. ἢ 


In Section 10-7 we will prove a far reaching generalization of this result. In 
the meantime, however, we conclude our discussion of pointwise convergence by 
evaluating a certain improper integral which will be encountered shortly. 


Lemma 10-2. / sinx 8 ζ. 
0 x 2 


Proof. Let f be the function in @C[—7, 7] defined by 


f(x) = τ sin 5 > —w< xX <i, x € 0, 


tole o¢ | = 


x = 0, 


3 


and let S,, denote the nth partial sum of the Fourier series for Καὶ Then since fis 
piecewise smooth on [—z, 7], Theorem 10-1 implies that S,(x9) — f(xo) as 
n— o for all xo in [—7z, x]. Setting x9 = 0, and using Formula (10-5), we 
therefore have 

1 [° sin (s/2) sin(n + 4)s 1 

τ Ι. . ΘΠ :π 2) “2 


asn— oo. We now use the fact that the integrand appearing in this expression 
is even to deduce that 


r 1 
I sin (n + DS as + * 


5 


asn— o. Hence 


(n+1/2)x . 
510 XxX τ 
/ dx —> = 
0 x 


as nm — οὐ, and we conclude that 


provided the integral exists. 
To settle this last point, we set 


Ay = 


kr . 
Sin xX 
[" sazgl| 
(k—-1)x * 
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FIGURE 10~1 


k = 1,2,.... Then, referring to Fig. 10-1, we see that the A; measure the area 
between the x-axis and successive oscillations of the curve sin x/x. Thus A; > 
Ay >-+::,and A; — Oas k — o (see Exercise 2). From this it follows that the 
alternating series 


Ay Ae Ag 
converges, and that 
> (ἡ Ag! < [Avail 
k=N+41 


Hence, if T is chosen so that (k — 1)t < T < kr, then 
oO kr | 

| sin x ΠΧ | nF gy ΕἸ 
T j%x T x 


< [4μ| + [4841]; 
and since A; — 0, the integral in question must converge. J 


3 (= 1)7}14; 


j=k+1 


lA 


EXERCISES 


1. Prove that the function g(s) defined by Formula (10-7) is piecewise continuous on 


[--π, 7]. 
kr : 
sin x 
| ax 
(k—1)x xX 


2. Let. 
Prove that 4; > Ag >---,and that 4, ~ Oask > ο. 


3. Show that 
| sint 1, < | sint 1 
0 t 0 ΐ 


A = 


ee es Το ον 2 


for all x. 
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4. (a) Let ἀκ. δὲ denote the Fourier coefficients of f Prove that the series 


ao < . 
ΟῚ + 2 (a, cos kKxo + by, sin kxQ) 


converges to f(xo) if and only if 


ag — 2f(xo) 


2 ΩΝ > [(ax cos kxg + 5b, sin kxo) cos Κα 


k=1 
+ (δ. COS kxo — ak sin kxo) sin kx] 


converges to zero at x = 0. 

(b) Show that the second of the above series is the Fourier series expansion of the 
function G(x) = f(x + xo) — f(xo). ([Hint: Make the change of variable t = 
x + xo in the formulas for the Fourier coefficients of G on [—7, 7] and use the 
periodicity of Δ] 

(c) Show that 


lim Gzr(x) = lim Gg(—x) = GeO) = 0, 
2—0t z— Ot 


where Gg is as above, thereby establishing the continuity of Gg at x = 0. 
(d) Show that the right- and left-hand derivatives of Gz exist at x = 0. [Hint: Note 
that 


Gr(h) — Ge) 1 S@ = GO) , Geb -- sa] 


h 2 h ho 
1 ΕΞ +h) = 700). fo -- ἢ) - τ | 
<9 h h 


. A continuous function f is said to satisfy a Lipschitz condition of order a if there exist 
positive constants M and a such that 


|f(x1) — f(x2)| < M|x1 — xl? 


for all x; and x2 in the domain of f. 
(a) Show that each of the following functions satisfies a Lipschitz condition on the 
entire x-axis. 
Gi) f(x) = c, caconstant 

Gi) f(x) = sinx 

(iii) f(x) = sin? x 

(iv) f the periodic extension to (©, ©) of the function x? in @C[—7, 7] 

(v) f the periodic extension to (— ©, ©) of the function |x?| in @C[—z, 7] 
(Ὁ) Let f be a piecewise continuous function of period 27, and suppose that f satisfies 
a Lipschitz condition of order a on the entire x-axis. Prove that the Fourier coeffi- 
cients of fthen satisfy the inequalities 
Mr“ Mx" 


χα [δ] = ea 


lax] < k 
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for all k > 0. [Hint: Make the change of variable x = t + (a/k) in the formulas for 
a; and b;,, and deduce that 


a, = aT | £0) -- f(x -{- 1) | cs kx dx, 
b, = - ᾿ | £@) - f(x +- i) | sin kx dx.] 


(c) Why is it uninteresting to permita > 1? 

. (a) Prove that every continuously differentiable function f on a closed interval [a, δ] 
satisfies a Lipschitz condition of order one on that interval. (See Exercise 5 above.) 
[Hint: Use the mean value theorem and set M = max|f’(x)| on [a, 5].] 


(Ὁ) Prove the following generalization of Theorem 10-1. Let fbe piecewise continuous 
on (— ©, ©) with period 27, and suppose that 


Gi) fis continuous at the point xo, and 
(ii) f satisfies a Lipschitz condition of order a for all x in an interval about xo. 


Then the Fourier series for f converges to f{(xo) when x = xo. [Hint: Follow the proof 
of Theorem 10-1.] 


. Let f be piecewise smooth on (— ©, ©) with period 27, and suppose that f(x) = 

4Lf(x+) + f(x-)] for all x. Prove that 

sin 
5 


ἊΣ ds. 


 - | fee +9 


[ Hint: Show that 


WT 


sin As 


7 LK eS) as 


sin As 
5 


ds 
5 


τ + ᾿ 
" Ι ἀξ ID aie ai) Ι 


sin As 
5 


0 — 
oe) eS Qa 


0 
sin (As) ds + f(x ) | 
and then apply the Riemann-Lebesgue lemma and Lemma 10-2.] 

. Prove that 

1 - _ sin (n + $)x 

27 2s COS peng) 


as follows. 
Use Euler’s formula 

οἷ» = cosx + isinx 
to deduce that 


1 n 
+ Σ᾽ cos kx 
k=1 


Noi 
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is the real part of 


Evaluate this expression by using the formula for the sum of the first m terms of a 
geometric series, and then find its real part. 

9. Let f be piecewise continuous and periodic on (-- οὐ, ©), with period 27. Prove 
that the same is true of the function 

sin (n + 4)s 


I + τ (5/2) 


10-4 UNIFORM CONVERGENCE OF FOURIER SERIES 


Now that we have settled the question of pointwise convergence for the Fourier 
series expansions of piecewise smooth functions, we propose to determine con- 
ditions under which this convergence is uniform on a closed interval [a, b]. Here, 
of course, we must impose additional hypotheses on the functions considered, 
and at first sight one might expect them to be rather stringent. Surprisingly, how- 
ever, we need only demand that the functions be continuous in order to guarantee 
both uniform and absolute convergence; an assertion which we prove as 


Theorem 10-2. Let f be a continuous function on (— οὐ, «) with period 27, 
and suppose that f has a piecewise continuous first derivative. Then the 
Fourier series for f converges uniformly and absolutely to f on every closed 
interval of the x-axis. 


Proof. Let 
ag bed : ao = ar) 
at Σ, (αι coskx + bysinkx) and ack 2, (aj, cos kx + δὶ, sin kx) 


be the Fourier series for fand f’, respectively. Then, since fis periodic with period 
21, 


ay = = " ΓΟ) ἀκα = ΣΧ) -- {-- τὴ = 9, 


while, for k > 0, 


a, = - f’(x) cos kx dx 


+k | f(x) sin kx dx 


= : | f(x) cos kx 


ok | fix) sin kx dx 
WJ er 


- kb, 


10-4 | UNIFORM CONVERGENCE OF FOURIER SERIES 381 


and 1 [" 
bi, = - f'(x) sin kx dx 
= Η] f(x)sinkx| --Κ = f(x)coskx Ἢ 
ΞΞ -- Και. 


Moreover, by Bessel’s inequality (Theorem 8-3), we have 


>. (a? + δ) < 4 | f(x)? « ο. 
k=1 a 
Thus 
» [kv αἱ + of)? < οὐ, 
k=1 


and we conclude that the sequence {kv/ αἱ + b?} k = 1,2,..., belongs to the 
Euclidean space ¢, of all “square summable”’ sequences of real numbers intro- 
duced in Section 8-5. But the sequence {1/k},k = 1,2,..., also belongs to fg. 
Hence the inner product of these two sequences exists, and it follows that the 


series 
> (1 -κν + 5) = >) Vai + b 
k=1 k=1 


must converge. 

Now, given any pair of real numbers a and ὁ, the Cauchy-Schwarz inequality 
in 6.2 applied to the vectors ae, + beg, and (cos kx)e,; + (sin kx)eo, 61, 6. the 
standard basis, implies that 


lacoskx + bsinkx| < Va? + b2/sin? kx + cos? kx 
- “8 - Be 


for all x. This allows us to compare the series 
ag = : 
7 | 4+. dy la, cos kx + by sin Καὶ 
with the convergent series of positive constants 
a io) ae 
S| + Do Ν αἱ + bi, 
k=1 
and the Weierstrass M-test (Appendix I) implies that 


ao = ; 
ae oe » (a;, cos kx + by sin kx) 
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is uniformly and absolutely convergent on any closed interval of the x-axis. 
Finally, by Theorem 10-1, we know that this series converges pointwise to f, and 
the proof is complete. J 


The reader should note that the hypotheses of Theorem 10-2 merely require 9.7 
to be piecewise continuous, and hence allow 77 to be undefined at isolated points 
of the x-axis. Thus the Fourier series expansion of a function such as the one 
shown in Fig. 10-2 converges uniformly and absolutely in every closed interval 
of the x-axis in spite of the fact that f’ does not exist at the points 277, n an in- 
teger. On the other hand, the theorem is certain to fail in any interval where f 
itself is discontinuous, since it is well known that the limit of a uniformly con- 
vergent sequence of continuous functions (in this case the S,(x)) is continuous. 
Thus the above result is the best that can be expected if we demand uniform con- 
vergence in every closed interval. By relaxing this requirement, however, Theorem 
10-2 can be generalized to include functions with jump discontinuities. In this 
case the result in question reads as follows. 


Theorem 10-3. Let f be piecewise smooth and periodic on (— 0, «) with 
period 2x. Then the Fourier series for f converges uniformly to f in any 
closed interval of the x-axis which does not contain a point of discontinuity 


of f. 


The proof is an easy consequence of the following lemma, which itself is a 
special case of the theorem. 


Lemma 10-3. Let 9 be the piecewise smooth, periodic function on (— 0, «) 
whose definition in the interval [—7, 1] is 


-3(1+2). apie ZO, 

2 π 

(x) = 0, x = 0, (10-8) 
3(1 -2)- O<x<rf, 
2 1 


(see Fig. 10-3). Then the Fourier series for φ converges pointwise to ¢ for 
all x, and the convergence is uniform on any closed interval which does not 
contain a point of the form 2xn, n an integer. 


FIGURE 10-2 FIGURE 10-3 
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Granting the truth of this assertion, Theorem 10-3 is proved in the following 
manner. 

Let x1, X9,... Xm be the points in (—7z, 7) where fis discontinuous, and for 
each i, i = 1l,...,m, let w; denote the magnitude of the jump discontinuity at 
x; [that is, ὦ; = f(xi') — f(x; )]. Then the function w,¢(x — x,) also has jump 
discontinuities of magnitude w; at the points x; + 2zn, but 15 continuous for all 
other values of x. Hence 


F(X) — ww(x — xi) 


is continuous both at the points where fis continuous, and at the points x; + 27n. 
In short, by subtracting w;o(x — x;) from f we have removed the discontinuities 
at the points x; + 2an without introducing any new points of discontinuity. We 
now repeat this process for each index i, to obtain the function 


f(x) - s wig(x — Xi), 
ἦΞ: 1 


which is piecewise smooth on (— #, οὐ), periodic with period 27, and continuous 
everywhere except possibly at the points +a, +37,.... [Such discontinuities 
will occur whenever f(—7z) ¥ f(7).] To remove these last discontinuities we 
set w, = Κ(τ ἢ) — f(x), and construct the function 


F(x) = fo) -- SD w(x — xi) — w(x — τ). 
i=! 


Then F satisfies the hypotheses of Theorem 10-2, and its Fourier series therefore 
converges uniformly to F in every closed interval of the x-axis. Moreover, Lemma 
10-3 allows us to assert that the Fourier series for the function 


&(x) = > wie(x — x;) + Wr(X — r) 


1=1 


converges uniformly to ® in any closed interval not containing a point of dis- 
continuity of f Hence the Fourier series for f, being the sum of the series for F 
and ®, must also converge uniformly in any such interval, and the theorem is 
proved. J 


To complete the argument, we now establish Lemma 10-3. Here we reason 
as follows. 
A routine calculation reveals that the Fourier series for ¢ is 


A. > sin kx (10-9) 
iat k 


and hence to prove the lemma it suffices to show that this series converges uniformly 
on every closed subinterval of [—7z, +] not containing the origin. 
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To this end we set 
sin 2x sin nx 
————- 3 


5 tere t = 


S,(x) = sinx + 


and let 
T,(x) = sinx + sin2x +--+: + sinnx. 


(Note that S, is the nth partial sum of the Fourier series for the function z¢.) 
Then, since sin kx = 7;(x) — T;,_1(x) for all Κα > 1, we have 


S,(x) = Tix) + BOS AC) 5 = 4 PQ) = Tra) 
or 
T(x) 


L#2 


T(x) Tn—1(x) 


πὰς T(x) | 
wae aaa ees ΠΩΣ 


n 


Sn(x) τὰ 


Moreover, by summing the trigonometric identity 


2 sin 5 sinkx = cos (k — 4)x — cos(k + 4)x 


as k runs from 1 to n, we find that 


cos (x/2) — cos (n + 3)x | 


ae) x #0, (10-10) 


T,(x) = 


from which it easily follows that 


IT,(x)| < Jsin Sx] 


for alln and all x # Oin[—7z, xz]. Thus, forn > m, and x ¥ Oin[—z, π], 


| T n(x) 


pe ON Tn —1(x) ue T(x) _ Tin(X) 
mim + 1) Fas 


εὐ εν esau n 


[Sn(x) ας m(X)| - 


Ϊ Ι ] | | 
mony Lae Ft tegen FAG) 
Now let x be restricted by the inequalities Ὁ < ὃ < |x| < a. Then 


ἡ x . ὃ 
“| > sin=> 
sin 5 2 sins 


and we have 


1 1 Ϊ ] | 
Pa) 79a wot ees aes earl ae a 
But since the series 


5 1 
Du kak 1) 
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is convergent, the quantity 


" 1 ] l 
oes alee cys lata 


can be made arbitrarily small by taking m and n sufficiently large. Hence, given 
any € > 0, there exists an integer N such that 


|Sn(x) a: m(X)| <7€ 


for all m,n > N, and all x with ὃ < |x| < a. This, of course, implies that 
3 sin kx 
fa ἢ 


is uniformly convergent whenever 0 < ὃ < |x| < a. The same is therefore true 
of the series for φ, and since the choice of ὃ in (0, 7) was arbitrary, we are done. J 


We have already observed that the Fourier series for a piecewise smooth func- 
tion cannot converge uniformly on any closed interval [a, b] containing a point 
of discontinuity of the function in its interior. To complete our discussion 
of uniform convergence, it remains to consider the behavior of Fourier series 


(c) FIGURE 10-4 (d) 
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in the vicinity of such discontinuities. The diagrams in Fig. 10-4, depicting the 
function 
—-l, —-7r< x <Q, 
ff) = 0, x = 7,0, 7, 
L; 0 «χ «π, 


and several of the partial sums of its Fourier series, are typical of the situation 
which obtains. From these diagrams it is apparent that the oscillations in the 
partial sums, S,,, of the Fourier series for f do not decrease at a uniform rate on 
the interval (0, 7) as n — o. On the contrary, the oscillations toward either end 
of this interval remain rather large for all values of n, and though these exceptional 
oscillations move toward the ends of the interval as n increases, they do not die 
out in the process. This peculiar behavior of the partial sums of a Fourier series, 
wherein these sums seem to gather momentum before plunging across a jump 
discontinuity, is known as the Gibbs phenomenon, after the American mathema- 
tician and physicist, J. W. Gibbs, who first discovered it. In the next section we 
shall analyze this phenomenon in some detail, and obtain a limiting value for the 
amplitude of the oscillations involved. 


EXERCISES 


Each of the following exercises refers to an arbitrary trigonometric series of the form 
“ΟΕ (acos kx + by sin kx) (10-11) 
2 k=1 


which, initially, is not assumed to be the Fourier series expansion of a function in 
ΦΘ[---π, 7]. 
1. Prove that whenever (10-11) converges in the mean in @C[—7, 7] to a function καὶ it 
is the Fourier series for αὶ 


2. Suppose that (10-11) converges uniformly on every closed interval of the x-axis. 
Prove that (10-11) then converges in the mean in @C[—71, 7], and is the Fourier series 
expansion of its limit. (See Exercise 1.) | 


3. Suppose that 
>, (ax! + bel) 


k=1 


converges. Prove that (10-11) converges uniformly and absolutely on every closed 
interval of the x-axis, and is the Fourier series expansion of its limit. 


4. Prove that the conclusion of Exercise 3 holds whenever 


1 1 
laz| < he’ lb.| < 13 
for all k > 0. 
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*10-5 THE GIBBS PHENOMENON 


We begin our analysis of the Gibbs phenomenon by examining the behavior of 
the partial sums of the Fourier series for the periodic function ¢ defined in the 
interval [—7, 7] by 


τ. Χ 
--- 9 


5 —r<x <Q, 
g(x) = 0. x ΞΞ. 9, (10-12) 
7, 0 «χ «π. 


(See Fig. 10-5.) The series in question is 


> ae (10-13) 
k=1 


FIGURE 10-5 


and by our earlier results we know that this series converges to ¢(x) for all x, 
the convergence being uniform on any closed interval not containing a point of 
the form 27n, n an integer. Figure 10-6 shows the graph of ¢ on the interval 
[—7, 7], together with the graph of the sum of the first six terms of its Fourier 
series, and again furnishes visual evidence of the fact that the partial sums of the 
series tend to “‘overshoot’’ the values of the function near a point of discontinuity. 


FIGURE 10-6 


Thus, the values of » between any two jump discontinuities range through the 
interval (—7/2, 1/2), while those of S,, the nth partial sum of (10-13), range 
through a somewhat larger interval [— ay, a,]. The limiting value of a, asn -- οὐ 
determines what is known as the Gibbs interval for ¢, and our first objective is to 
obtain a precise description of this interval. 

To this end we observe that a real number y will belong to the Gibbs interval 
for φ if and only if there exists an increasing sequence of positive integers {n;}, 
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k = 1,2,..., anda sequence of real numbers {x;} converging to zero, such that 


lim Sn(xn) = γι (10-14) 


Informally, (10-14) asserts that we can approach y as closely as we wish by points 
which lie on the graphs of a certain subsequence {S,} of the sequence of partial 
sums {S,}. (See Fig. 10-7.) To find all points y which satisfy this condition we 
consider the expression 


x xy “. sin kx “Ty a 
5 + S,(x) = a 2, ef Ε + 2) cos μ dt. 


0 


Then, by Formula (10-4), we have 
“[1 2 sin (n + 4)t 
x kt| dt = : ee dt 
Ι Ε τ d, “Ὁ » 2sin (1/2) 
_ a sin (n + 2)1 oy 
τ ἡ ἡ t/2 


ΕΝ . ΕΞ (1/2) - | SI ech 2) δ 


Thus 
Six) = —F +5 Ἢ sn at —e aM αι 
+ = af ΕΞ (72) - AI sin (n + 4)t dt. (10-15) 
We now make the substitution u = (m + 4)t in the first y 


of these integrals to obtain 


| x, fads 1, (n+1/2)z sae 
oa tia La LG Fo are 
ai 172 dt [ ᾿ du. 


Next, an easy application of l’H6pital’s rule shows that 


lim 


ΕΞ ] I ἡ} = 
pools). 5.72]. Ὁ Ὁ 


and hence that the function 


Ϊ 1 
sin (t/2) . t/2 FIGURE 10-7 


* The reader who is so inclined may take this statement as a formal definition of the 
Gibbs interval for ¢. 
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is continuous on the closed interval [0, x], provided it is assigned the value 0 
when ¢ = 0. Moreover, if 


F(n; x) = a) scary — Js | sin (n + 4$)t dt, 


it is not difficult to show that 
lim F(n; x) = 0 


xz—0 
uniformly in n; i.e., given any € > 0, a 6 > Ocan be found such that for all n, 
|F(n; x)| < € whenever |x| < ὃ. (See Exercise 1 below.) Thus (10-15) may be 
rewritten 


(n+1/2)r | 
sin ὦ 


Sn(x) = nee dt + FM; x), 


and it follows that if {x;,} is any sequence of real numbers which converges to 
zero, and if {n,} is an increasing sequence of positive integers, both chosen so that 
{x,n,} has a limit, h, as k — oo, then 


sin 1 td 


lim Sn(Xke) = εἰ 


(Note that every real number ἢ can be expressed as a limit of this form, and that in 
certain cases A may assume the values +00.) Hence every point of the form 


[sa ee ee 


belongs to the Gibbs interval for ¢. 

Conversely, if yo belongs to the Gibbs interval for y, there exist sequences 
{x;,} and {n,} with the property that S, (xn) > Yo as Καὶ — oo. But then there 
exists a subsequence {my-x,} of {npxx} which either converges or else diverges 
to +o.* If A denotes the limit of this subsequence, then (10-15) (in its amended 
form) implies that 


: : ser ad 


and we have shown that yo can be expressed in the form 


[= sint | 


* This is a consequence of the famous Bolzano-Weierstrass theorem which asserts 
that every bounded infinite set of real numbers has a limit point. For a proof see Buck, 
Advanced Calculus, 2nd Ed., McGraw-Hill, New York, 1965. 
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for a suitable value of h. Hence we have proved the following theorem. 


Theorem 10-4. The Gibbs interval for the function y defined above is the 
set of all real numbers y of the form 


y Ἢ i Sat at (10-16) 


with -τ- <h< 


Actually, we can say even more than this. For, referring to Fig. 10-8, and using 
the interpretation of the integral as area under the curve, we see that (10-16) 
assumes its maximum value when ἢ τὸ π. Thus the Gibbs interval for ¢ is 


[πὰ [5 


Moreover, since the value of 


f sata 


is known to be (1/2) 1.089490 . .. , it follows that the length of the Gibbs interval 
for φ is appreciably greater than the magnitude of the jump discontinuity in ¢ at 

= 0. Once again this implies that the Fourier series for ¢ is not uniformly 
convergent in any open interval having a point of discontinuity of φ as one of 
its end points. 

It is now a simple matter to pass to the case of an arbitrary piecewise smooth 
function. Indeed, if f is piecewise smooth on [—7, π] with a jump discontinuity 
at Xo, then, arguing as in the proof of Theorem 10-3, the function 


2π 3π : 


FIGURE 10-8 


x x 
g(x) = f(x) -- Καὶ — JOO) o¢ v(x — Xo) 
is continuous in some closed interval of the form [x9 — 6, Xo + ὃ] about Xo, 
and has a uniformly convergent Fourier series on that interval. But since 


Καὶ) -- $29) κι 


.-- Χο)» 


F(x) = g(x) + 


we conclude that the Gibbs interval for f at x9 must be the same as the Gibbs 
interval for the function 


Κατ) — PEON ὩΣ: χὸ: 


τ 
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Thus, on the vertical line x = x 9 the Gibbs interval for f consists of all points y 
such that 


lA 


— fd) + fe) 
y 2 


fat) -- flo) | ; mi 
τ 0 

_ (Gd) -- ΓΟ) 2. | ‘sint 4, 
2 0 


T t 


_ μοῦ) = feo) 5 fol 1 ogo4o0 . . . 


In short, the length of the Gibbs interval for fat xo exceeds the magnitude of the 
jump discontinuity in f at that point by the factor 1.089490.... 


EXERCISES 


1. Let ἢ: 1 i]. 
F(n; x) = 9 ἢ aes = ΒΗΓ (n + 5)t dt. 


Prove that lim,_,9 F(n; x) = Ο uniformly in ἡ. 


10-6 DIFFERENTIATION AND INTEGRATION OF 
FOURIER SERIES 


With the results we now have available it is an easy matter to settle the basic 
questions concerning the termwise differentiability and integrability of Fourier 
series. The relevant theorems in this connection are as follows. 


Theorem 10-5. (The differentiation theorem.) Let f be a continuous 
function on (— 0, «), with period 2x, and suppose that f has a piecewise 
continuous first derivative, Κ΄. Then the Fourier series for 7’ can be obtained 
by differentiating the series for f term-by-term, and the differentiated series 
converges pointwise to f’(x) wherever f" exists. 


Proof. Let 

ao = Η 

> - dy (a, cos kx + δ sin kx) (10-17) 
and 

ao = ! ae 

eS dy (ai, cos kx + bj, sin kx) (10-18) 


be, respectively, the Fourier series for f and f’. Then, as was shown in the proof 
of Theorem 10-2, ag = 0, and, for k > 0, 


αἰ, ΞΞ kby, bi, ΞΞ — Και. 
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Thus, (10-18) is 
Σ; k[b, cos kx — a, sin kx], 
k=1 


which is precisely the result obtained by differentiating (10-17) term-by-term. 
This proves the first statement in the theorem, while the second is a consequence 
of Theorem 10-1. J 


From this, and Theorem 10-2, we immediately deduce 


Corollary 10-1. Let f be continuous and periodic on (— οὐ. «), with period 
2x, and suppose that f has a continuous first derivative and piecewise con- 
tinuous second derivative. Then the Fourier series for ζ΄ is uniformly and 
absolutely convergent on every closed interval of the x-axis, and can be 
obtained by differentiating the Fourier series for f term-by-term. More 
generally, if f, f’,...,f‘"—» are continuous, while f is piecewise con- 
tinuous, then the Fourier series for f j= 1,...,2 — 1 converges uni- 
formly and absolutely to f (7) on every closed interval of the x-axis, and can 
be obtained by differentiating the Fourier series for f term-by-term j times. 


Turning to the integration of Fourier series we now prove 


Theorem 10-6. Let f be a piecewise continuous function on (—«, «) with 
period 2, and let 


= + > (a, cos kx + by sin kx) 


k=1 


be the Fourier series for f. Then 


b 
| f(x) dx = ὁ — a) 
@. a,(sinkb — sin ka) — δκίοοβ kb — cos ka) 
ἘΣ. in kb = sin ka) — διέθου kb — eos). 


k=1 


(10-19) 


In other words, the definite integral of f from a to b can be evaluated by 
integrating the Fourier series for f term-by-term. 


Proof. Set 
F(x) = | 'Λι -- Ἵ dt. (10-20) 


0 


Then F is continuous, has a piecewise continuous first derivative, and is periodic 
with period 27 (Exercise 1). Thus F can be expanded in an everywhere convergent 
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Fourier series as 


F(x) = fs + De (A; cos kx + B, sin kx), 
k=1 


and an easy computation reveals that 


Ar = -- =>? 
ὺ (10-21) 
B= =>? ΚΣ 1. 
Hence 
A a, sin kx — δὰ cos kx | 


4... ς 
Ὁ Κ 


and it follows that 
᾿ Α ας sinkx — b,cosk 
[ fd = Pet G+ eee. (10-22) 
pea) 
We now use the fact that 


[τὰ = [ soa — [ soa 


to deduce that 


b 
_ ao τὸ a, sinkb -- b;, cos kb 
[ὦ - a ees or 


οο 


Ν > a, sin ka — by, cos ka 
k 


k=1 


Finally, since both of these series are absolutely convergent, the necessary re- 
arrangement of terms leading to (10-19) can be effected, and we are done. ἢ 


In much the same way we can also prove the following theorem. 


Theorem 10-7. (The integration theorem.) Let f be an arbitrary function 
in @C[—-7, π] with Fourier series . 


ao : Ic 0-2 
— + 2 (a; cos kx + δα sin x). (1 3) 
Then the function 


/ f(t)dt, --π <x <n, 
0 
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has a Fourier series which converges pointwise for all x in the interval (—r, 7), 
and 


fd = ETD ene St es sin kx 
= = 
" " (10-24) 


Remark. The reader should note that since fis arbitrary in @C[—z7, π], the series 
in (10-23) need not converge to f(x) everywhere in [—7, π]. This not withstanding, 
the series for Jof(2 dt does converge pointwise as asserted in the theorem. 


Proof. Reasoning as in the proof of Theorem 10-6, we have 


‘i a, sinkx — b, cos kx 
[sora = Sa es Seen = cate, 


—r < x < π. (See Formula 10-22.) We now set x = 0 and find that 


Ao _ yr Fe, Ξ 
5. (10-25) 


and hence that 


~. by Ἔν a, sin kx — by cos kx 
[ toa- ee Se 


k=1 k=1 
But when —7 < x < a, 


= sin kx 
5 os Ds ( eo 
| k=1 
Thus ᾿ 
= = __4\k+1 sin kx = br 
[, Rod = δι 1) i ay 


ἘΣ a, sin Κα — 7 ve Sos BX 
an expression which is clearly equivalent to (10-24). J 


EXERCISES 


1. Verify that the function defined by Eq. (10-20) is periodic with period 27, and com- 
pute the coefficients A; and 8; (k > 0) of its Fourier series. 


2. Let fbe a function in PC[—7z, +] with Fourier series 


> + 2, (a, cos kx + by, sin kx). 
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Prove that 


ied ao(x + 1) 1 SB a, sinkx — b,(coskx — cos kr) 
ie = 2 k 

k=l 

for --π < x «π. 


. Suppose that the function f considered in Theorem 10-7 is piecewise continuous on 
(— οὐ, ©) with period 27. Is Formula (10-24) then true for all x? Why? 


. Let fbe a piecewise continuous odd function on (— ©, ©) with period 27. Prove that 
=. by “ by 
[ fdt = Σὺ τὸ -- DF cos kx 


. Starting with the series 


Feit SE, τα <xcn 
k= 


for all x. 


k 


use Theorem 10~7 to prove that 


2 00 
χ π΄ z= κ COS Kx 
ΠΣ Κ᾿ 


and that 


3 re) 
x π᾿ yt sin = 


for --π < x < mw. See Exercises 14(b) and 15(b) of Section 9-4. 
. Show that the trigonometric series >>,» sin kx/In k is not the Fourier series of any 
function @C[—7, π]. [Hint: See (10—25).] 


. (a) Let {f,},k = 1,2,..., be a sequence of functions in @C[—z, 7] which con- 
verges in the mean to f. Prove that 


T 


ha 7 Sk (x)g(x) dx = Ε f(x)g(x) dx 


for all g in @C[—7z, π]. [Hint: Apply the Cauchy-Schwarz inequality to the functions 
f — fr and g in GC[—7, π].] 

(Ὁ) Use the result in (a) to deduce that if >>;_1 f, converges in the mean to f in 
ΦΟ[--π, 7], then 


0 


i fx)elx) dx = 5] fee 8@0) Ἢ 


ey 
for all g in ΦΟΙ -- τ, 7]. 


(c) Let fand g be piecewise continuous on (— ©, ©) with period 27, and let az, δὰ 
and ακ. 8; be, respectively, the Fourier coefficients for fand g. Prove that 


aan 


+ Σ (ακαρ + διβμ). 


2 | jo 
WJ —xr 
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10-7 SUMMABILITY OF FOURIER SERIES; 
FEJER’S THEOREM 


We have already had occasion to remark that the Fourier series for an arbitrary 
function fin @C[—-7, π] may be divergent for certain values of x. In such a case 
one would naturally be inclined to feel that the series in question was a rather 
poor approximation to f, and, in particular, that it would be impossible to deter- 
mine f from its series in the absence of any additional information. One of the 
really remarkable properties of Fourier series is that this impression is entirely 
false, and that the value of f(x) can be found at all x where f is continuous even 
though the Fourier series for f is divergent in the usual sense. Needless to say, 
the method of ‘‘summation’’ which is used to accomplish this feat must be quite 
different from the standard one involving the partial sums of the series, and yet, 
at the same time, must yield the value which would be obtained by the method 
of partial sums whenever the latter do converge. In this section we shall introduce 
this new technique of summation, and then use it to prove Fejer’s theorem—one 
of the most important results in the entire theory of Fourier series. 
Let 
Ag Ὕ αι + adg2+ °°: (10-26) 


be an infinite series of constants with partial sums 


δὲ͵ = 4g +, +°°° + Gk, 


k = 0,1,2,.... Then the sequence of arithmetic means associated with (10-26) 
is, by definition, the sequence {o;}, k = 1, 2,..., with 
= Sof σι FE Sed (10-27) 


for allk > 0. If this sequence converges to a limit o as k — οὐ, that is, if 


limo, = @, 


ko 


we then say that (10-26) is summable by the method of arithmetic means, or Cesaro 
summable, and σ is called the Cesdro sum of the series. 


EXAMPLE 1. Consider the series 


1-1l+1-—-14°:°° (10-28) 
with partial sums 
ae 51:1 = 0, So = l, S3 = 0,.... 


In this case the sequence of arithmetic means is 
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with general terms 


k+ 1 


02k = π᾿’ O2k+1 = κει 


Nol] "π 


and has Ζ 85 ἃ limit. Thus (10-28) is Cesaro summable, with sum 5, even though 
the series diverges in the usual sense of the term. 


EXAMPLE 2. The geometric series 


with partial sums 


so Ss; = 1+ 3’ eee 9 Sh = 2 — πε’ eee 9 


converges to the value 2. In addition, it is Cesaro summable to the same value, 
since, by (10-27), | 


Cp. = = (S0-F δι τ Sei) 


I 
No 
| 
| 
fo 
We) 
| 
ie) 
ων 
| γ- 
ee a 


and 


These examples suggest that the notion of Cesaro summability is a generalization 
of the notion of ordinary convergence of the type stipulated above, in that the 
Cesaro sum of a convergent series always exists and is equal to the ordinary sum 
of the series. We now prove that this is the case by establishing 


Theorem 10-8. Jf an infinite series — 
ag ta; 45 - °°: (10-29) 


converges to the value a, then the series is Cesaro summable, and its Cesaro 
sum is 6. 


Proof. Let e€ > 0 be given. Then since (10-29) converges to o, there exists an 
integer N such that 
E 


sn — σὶ <5 
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for alln > N. We now consider the quantity 


Be sess je OO Se Sit) τ 
n 
1 ΞΕ 
= - (s, — σ). 
fas a, 
Then for n > Ν, we have 
l N n 
lo, — a| st Σὺ δι -- σε > οι -- 9) 
k=0 k=N-+1 
ΠΡ, i Ge! 3 ls, — o| 
—~ n n : 
k=0 k=N+1 


But by assumption, |s, — o| < €/2 fork > N. Hence 


I< n— Nfe 
ΤΠ <8 SCG) 


k=N +1 


I 

. γι 

| 

= | 
τ 
Nol om 
nN” 


Moreover, since Ν is fixed, the quantity 
1 «ὦ 
μ᾿ >. |sz — σι 
k=0 


can also be made less than €/2 by choosing n sufficiently large, say n > N’, and 
when this is done we have 


€ ε 
lon -- σ]ὶ «5 +5 = € 
whenever n > max [N, N’]. J 


The method of Cesaro summability can, of course, be applied to an infinite 
series of functions 


> ay(x). (10-30) 


k=0 


In this case we say that the series is Cesdro summable at the point xo if the nu- 
merical series 


eo 


Σ, ax(Xo) 


k=0 
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is Cesaro summable in the sense of the above definition, and that (10-30) 1s uni- 
formly (Cesaro) summable on an interval [a, b]if the sequence {o;,(x)} of arithmetic 
means associated with (10-30) converges uniformly on [a, δ] to a function g(x); 
1.6., if, given any € > 0, an integer N can be found such that |o,(x) — a(x)| < ε 
for all x in [a, b], and all n > N. In these terms the proof of Theorem 10-8 also 
serves to establish 


Theorem 10-9. Jf the series 


io a) 


Σ) a(x) 


k=0 


converges uniformly to a(x) on an interval [a, δ], where the a;(x) belong to 
@C[a, b], then the series is uniformly summable on [a, b] to the same func- 
tion a(x). 


With these preliminaries out of the way, we now state the theorem which 
justifies introducing the notion of Cesaro summability. 


Theorem 10-10. (Fejer’s theorem.) Jf fis a continuous function ΟἹ (--- οὐ, «) 
with period 27, then its Fourier series is uniformly summable to f on every 
closed interval of the x-axis. 


We have already stated that this theorem is one of the most important in the 
theory of Fourier series, and before giving a proof we point out some of its far- 
reaching consequences. In the first place, the conditions imposed here are not 
sufficient even to guarantee that the Fourier series for fconverges pointwise, much 
less that the convergence be uniform. In spite of this, Fejer’s theorem asserts 
that we can “‘sum”’ the series in question, and thereby recover the function Καὶ 
Moreover this summability is sufficiently well behaved so as to proceed uniformly 
on closed intervals—a truly remarkable fact. Hence one can legitimately say that 
the Fourier series for a continuous periodic function in @C[—7, π] does serve to 
determine the function from which it was derived. (At the end of this section we 
shall generalize these results in the usual way to piecewise continuous functions as 
well.) | 
Finally, we note that Fejer’s theorem also implies the following fact. 


Theorem 10-11. Jf a trigonometric series 
Ὁ + DS (a cos kx + by sin kx) (10-31) 
k=1 


is known to be the Fourier series of a continuous function f on (—», »), 
and if this series converges in the usual sense when x = Xo, then the series 
must converge to f(xo). 
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Proof. By Fejer’s theorem, (10-31) is Cesaro summable to f(x) for all x. If, in 
addition, (10-31) converges pointwise when x = Xo, then, by Theorem 10-8, the 
value of the series must be the same as its Cesaro sum, namely f(xo). J 


At first sight Theorem 10-11 may seem to be stating the obvious, since the 
reader has probably long since assumed that a Fourier series must converge to 
the function from which it was obtained if it converges at all. Until now, however, 
we have proved this fact only for piecewise smooth functions, and there is nothing 
in our earlier results to prevent the Fourier series for a continuous function from 
converging pointwise to an entirely different function. This, as we now see, is 
impossible. 

Turning to the proof of Fejer’s theorem 
we begin by establishing an elementary lem- | | 
ma on approximating continuous functions, | | 
which, though obvious, does stand in need 
of proof. The result in question asserts that | | 
every continuous function on a closed inter- ΘὃΘὁ SSCS 
val can be uniformly approximated by a 
“broken line function,” meaning a continuous FIGURE 10-9 
function whose graph is made up of a finite 
number of line segments as shown in Fig. 10-9. Since we shall have occasion to 
refer to this result in our later work, we state it formally as follows. 


Lemma 10-4. Let f be a continuous function on a closed interval [a, b]. Then, 
given any € > 0, there exists a broken line function B on [a, δ] such that 


f(x) — BO)| «ε 
for all x in [a, δ]. 


Proof. The proof follows the construction illustrated in Fig. 10-10, and goes as 
follows. 
Since fis uniformly continuous on [a, b] there exists a 6 > Ὁ such that 


fer) — flea) <5 (10-32) 


whenever |x; — χοὶ < ὃ. (Theorem I-13, Appendix I.) Moreover, since [a, δ] 
is of finite length we can find points 


Ω - χρ Φχι 4“: < X= ὃ 


in [a, b] such that each of the intervals %, = [xx~1, xz] has length less than 6. 
The function B is now constructed by successively joining the points (x9, f(xo)), 
(x1, κα)... ., (Xn, f(%n)) on the graph of f by straight line segments. Thus 
if x belongs to the interval ἢ}, 


BOX) = Ια + POD Ξ ἴδε. χρὴ 


Xk — Xk~ 
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(xn, f(xe)) 


| (xh 1, χκ.1)) 
| | 
| | | 
= of ee Ses ον ell Ι΄.“ ee a (eRe a Oe ee τὸς 
a=Xyo Χι X2 Xn-2 Xn Xn=b Xk—l Xk 
| FIGURE 10-10 FIGURE 10-11 


(Fig. 10-11), and we have 


(= fi δ αν ΞΕ εξ 55 


(ΛΟ) -- BOO| = 1) — fle 
< (92) -- fray) + LD Ξ ἔσταν iy — ah 


But by (10-32), 
FO) — fora <z> [fe -- Λα) <> 


and since 
|x — χρυ 


«1 
[xn — Xe-al ~ 


we conclude that 
ε 
Ifa) — BR)| <5 +5 = ε 
as required. jf 


Our next result is the key to the proof of Fejer’s theorem, and is of sufficient 
independent interest to be stated separately. 


Lemma 10-5. Let f be piecewise continuous on (— οὐ, «) with period 27, 
and let M denote the maximum value of |f(x)| for all x. Then if o,, denotes 
the nth arithmetic mean of the Fourier series for f, 


lon(x)| < M 
for all n, and all x. 


Proof. If s,(x) denotes the nth partial sum of the Fourier series for f, then by (10-5), 
ioe sin (n + 4)s 
Sn (x) = ἘΞ κ᾿ I(x ar 5) 2 sin (s/2) ds. 
Hence 


ΝΙΝ "fie +s) Ἀπ, ᾿ 
σ,(Χ) ΞΞ ne BIE sin (k +- bs ds. 
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But by summing the identity 


2 sin 5 sin (k + 3)s = cosks — cos(k + 1)5 


as k runs from 0 to n — 1, we obtain : 
ets 1 
2 sin 5 sin (k + 3)s = 1 — cosas 
k=0 
= 2 sin? 5 5, 
and it follows that 
sin” (n/2)s 
on(x) = τις ΠΣ as, (10-33) 


Now when f(x) = 1, it is clear that s,(x) = 1 for all k (consider the Fourier 
series for f). Thus, in this case, o;,(x) = 1 for all k, and (10-33) yields 


1 (΄ sin?(n/2)s , 
— ; ant (7 = | (10-34) 


Hence if | f(x)| < M for all x, 


sin sin* (n/2)s ας 
lon(x)| < — ay 2 sin? 2 sin? (5/2) ane 


as asserted. J 
With these facts in hand, the proof of Fejer’s theorem is all but obvious. Indeed, 


let f be continuous and periodic on (— , οο) with period 27, and let € > 0 be 
given. We must show that if 7 is sufficiently large, 


(0) -- 7,(x)| < € 


for all x, where σ, is the nth arithmetic mean of the Fourier series for f. 
But by Lemma 10-4, we can find a continuous broken line function B, with 
period 27, such that 


fx) — BO) < 3 (10-35) 


for all x. Setting 
g(x) = f(x) — BO), 


so that |g(x)| < €/3 for all x, we let σῇ and a; denote, respectively, the nth arith- 
metic means of the Fourier series for g and B. Then since 


f(x) = g(x) + BO), 
we have 


On(x) = on(x) + On (x) 
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for all x, and it follows that 


If(x) — on(x)| = |g) — on(x) + BO) — an'(x)| 
< |g(x)| + lon(x)| + |B) — on). 


But since |g(x)| < €/3 for all x, Lemma 10-5 implies that the same is true of 
lo;,(x)|. Finally, since the Fourier series for B converges uniformly to B on every 
closed interval of the x-axis, Theorem 10-9 allows us to conclude that its as- 
sociated sequence of arithmetic means also converges uniformly to B. Hence 
there exists an integer N such that 


|B(x) — of!(x)| < 5 
for alln > Nand all x, and we have 
ε ε ει 
ΧΧ) -- σι Ἵ] < 3 Ἔ 3 + 3 & 


which is precisely what had to be shown. Γ 


Functions with jump discontinuities can be handled in much the same way, in 
which case we have the following generalized version of Fejer’s theorem. 


Theorem 10-12. If f is piecewise continuous on (— οὐ, ©), with period 2π, 
then the Fourier series for f is Cesaro summable for all x, with sum 


fx*) ΚΧ 
2 


Furthermore, this summability is uniform on any closed interval of the x-axis 
not containing a point of discontinuity of f. 


The proof has been left to the reader as an exercise (Exercise 8). 

At this point we can truthfully say that the theory of Fourier series for piece- 
wise continuous functions is complete. Indeed, we now know that every such 
series is “‘summable,” either in the standard fashion when the function involved 
is piecewise smooth, or by the method of arithmetic means. Moreover, the series 
will always converge pointwise in either the standard or Cesaro sense to the func- 
tion from which it was derived (so long as the obvious proviso is made for points 
of discontinuity), and this convergence will be uniform on any closed interval 
in which the function is continuous. Truly, then, there is little more to be said. 

At the same time, however, the reader should not be misled into thinking that 
we have uttered the last word on the subject of Fourier series. This is far from 
being the case. Nevertheless, at this point the direction of inquiry changes abruptly, 
and addresses itself to the task of generalizing the above results to wider classes 
of functions. Such generalizations do exist, but are based upon an entirely dif- 
ferent type of integral than the one we have been using, and are beyond the reach 
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of an introductory text. Thus, as soon as we have settled the one point which still 
remains outstanding (i.e., the Weierstrass approximation theorem) our discussion 
will be complete, and we can turn our attention to other types of orthogonal 
series, and their applications to physical problems. 


EXERCISES 


1. 


Let Σῖχεο ax and Σῖχορ δὲ be Cesaro summable, with sums σ and τ, respectively. 
Prove that 


Σ, (aa, + Bbx) 
k=0 


is Cesaro summable with sum ac + @r for all real numbers a, 8. What does this imply 
about the set of all Cesaro summable infinite series? 


. Let Σ χορ be Cesaro summable, with sum o. Prove that Σ χομ az is also Cesaro 


summable for all n > 0, and find the sum of the series. 


. Find the Cesaro sum of each of the following series. 


(ay i ἘΞ. Or ΤΕ OS bases 
(b)1+0+0—14+0+04+1+0+0-—1+::: 


. (a) Show that the series 


sin x + sin2x + sin3x -Ἔ τ" 


is Cesaro summable to zero in the interval (0, 27). [Hint: Use Formula (10-10).] 
(b) Show that the series 


1 + cosx + cos 2x + cos3x +°-°: 


is Cesaro summable to zero in the interval (0, 27). [Hint: Use Formula (10-4).] 


. Let (ao/2) + Σ χει (ας cos kx + δι sin kx) be the Fourier series expansion of a 


function f in @C[—7, π], and let {0;} be the sequence of arithmetic means associated 
with this series, that is, ¢o, = (So - τ΄ + S,—1)/n. Prove that 


ω n 2 00 
1 [ [on(x) -- ,Οὐ᾽ dx = Σ᾽ (*) (αὐ + bi) + DS Ge + δὶ). 
ae k=1 


k=n-+1 


. Letao + a1 + ae - τ": bean infinite series with arithmetic means o;,k = 1,2,..., 


and, for each k, set 


lies a - wean  σμ 
k 


The sequence {r;} obtained in this way is known as the sequence of second arithmetic 
means associated with the given series, and the series is said to be summable to the 
value τ by the method of second arithmetic means if lim;,_.. 7, = τ. (Higher orders 
of summability by arithmetic means can also be defined.) 


(a) Prove that the series 


Tk = 


1—-24+3-44::: 


is not Cesaro summable, but is summable by the method of second arithmetic means. 
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(b) Prove that every series which is Cesaro summable is also summable to the same 
value by the method of second arithmetic means. 
7. Let s, and o; denote, respectively, the kth partial sum and arithmetic mean of the 
series 
ago +ai+az2t+:":. 
(a) Show that 
Srot = (kK + Donzi — Και, k > 0, 


and use this result to prove that limy_..0 s%/k = 0 whenever ap + a1 + a2 + τ 15 
Cesaro summable. 
(b) Use the result in (a) to deduce that the series 
12 — 22 4 32 — 44 4--- 
is not Cesaro summable. 
8. Prove Theorem 10-12. [Hint: First show that it is sufficient to prove 


τ 


. 1 ΕἸ sin” (n/2)s Ν 
nee SIS) τὰ ΝΡ ΤΟΤΥΕΙΣ ae 
and 
as in? (n/2) 
_ sin” (n/2)s 
Lae oe f(x NF Sin? G/D = ° 


for all x. Let « > 0 be given, and divide the integral appearing in this expression 
into two parts as 


sin’ (n/2)s 


2 sin? (s/2) ἴὼ 


ὃ 
1 
a i Lf + 5) — ΚΑ Ἢ 
sin’ (n/2)s 
2 sin2 (s/2) 


where 6 is chosen so that | f(x + 5) — f(x)| « ε for all s in the interval (0, 6]. 
Treat the second limit similarly.] 


rae | Le + 9) — £6 ds 
AW J56 


*10-8 THE WEIERSTRASS APPROXIMATION THEOREM 


To establish the version of the Weierstrass approximation theorem cited in the 
preceding chapter we must first show that every continuous periodic function on 
(— οὐ, «) can be uniformly approximated by a “‘smooth” function. This is the 
content of 


Theorem 10-13. Let f be continuous and periodic on (— οὐ, «) with period 
2π, and let € > O be given. Then there exists a function g which is continu- 
ously differentiable and periodic on (—«, ©) with period 2m, such that 
[70 — g(x)| < € for all x. 


Proof. For each ὃ > 0 let 


ὃ 
ΕΣ = [. δ άι 
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(Note that F5(x) is the average value of f(x) in the intervalx — ὃ < t < x 4+ δ) 
Then Fs is continuous and periodic on (— οὐ, 0) with period 27, and if we set 
u= x + t, so that 


Ι x+6 
F3(x) = Δ f(u) du, 
we find that 
F(x) = sg Lf + 8) — fle — δὴ 


(see Appendix I). Thus F; is also continuous and periodic on (— οὐ, οὐ). 
Next, we observe that 


Ι 


50.) -- 0) 


Ι x+6 Ι xr+6 
[. f(u) du -- a F(x) du 


Ι x+té6 
[τω - food 
xz+6 


<5], Mw) -- S| du. 


But since f is continuous and periodic on (— 0, 0), it is uniformly continuous, 
and hence there exists a number ὃ = δ(ε) such that | f(u) — f(x)| « € whenever 
lx — u| < 6(€). We now set g = ἔξ» and use the above inequality to deduce 
that 


r+6(e) 
I 
le) — SOS x56 Ι “go MOO -- FOO du < et 


Theorem 10-14. (The Weierstrass approximation theorem for trigono- 
metric polynomials.) Jf f is continuous and periodic on (—«,) with 
period 27, then, given any € > 0, there exists a trigonometric polynomial 


N 
Ty(x) = 40 + Σ, (A; cos kx + B, sin kx) 
‘ k=1 
such that 
f(x) — Ty(x)| < ε 
for all x. 


Proof. According to the preceding theorem we can find a function g such that g 
and g’ are continuous and periodic on (—«, «) with period 27, and | f(x) — 
g(x)| < ¢/2 for all x. Thus if 7, denotes the trigonometric polynomial consist- 
ing of the nth partial sum of the Fourier series for g, Theorem 10-2 implies that | 
there exists an integer N such that |g(x) — Ty(x)| < €/2 for all x. Hence 


Ye) -- ΤΥ ΟἹ < Lf) -- 8@)| + Ie) — ΤΥ ΟἹ] «5 +5 = 6 


and we are done. ἢ 
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In the next chapter we shall have occasion to refer to the version of the Weier- 
strass approximation theorem which uses ordinary polynomials, and hence we 
now prove this result as well. Our argument is based on Theorem 10-14, and 
begins with the following lemma. 


Lemma 10-6. /f 
T(x) = ao + Σ, An COS kx (10-36) 


k=1 


is a trigonometric polynomial involving only cosine terms, then there exist 
constants Ay, Ay,..., An Such that 


T(x) = 40 + Ai cosx + τ" + A, cos” x. 


Proof. When n = 0 or n = 1 there is nothing to prove. Thus we can proceed 
by induction, assuming the validity of the lemma for all trigonometric poly- 
nomials of degree n — 1 or less (n > 1). Let T be given as in (10-36). Then 


n—1 
T(x) = ag + (Σ ay, COS kx) Ἢ dn COS NX, 


k=1 
and, by assumption, we can find constants Ao,..., An—, such that 


T(x) = 49 + A; cosx +--: + A,_1 cos"! x + a, cos nx. 
But 
cos nx = 2cos[(n — 1)x]cos x — cos (n — 2)x, 


and, applying the induction assumption once more, we can write cos (n — 1)x 
and cos (m — 2)x as polynomials involving powers of cos x. This, of course, 
implies that J can be written in the desired form. J 


Theorem 10-15. Let f be continuous on the interval [—1, 1], and let e > 0 
be given. Then there exists a polynomial P such that 


f(x) — P| «ε 
for all x in [—1, 1]. 


Proof. Consider the function 
F(t) = f[cos ἢ] 


for —x <t< 7. Then F is continuous, periodic, and even. Hence the F; 
approximations of Theorem 10-13 are also even, and it follows that their Fourier 
series contain only cosine terms. Thus, by the preceding lemma a partial sum 
T(t) = 40 + Ai cost - τ  Α, cos” t of the Fourier series for some F; 
will satisfy 

|F(t) — Τῇ < « 
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for all ¢ in [-- π, +]. Setting x = cos ¢ yields | f(x) — P(x)| < ε for all x in 
[—1, 1], with 


P(x) = Ay + Ax + nie + A,x”. § 
From here it is an easy step to our final result. 


Theorem 10-16. (The Weierstrass approximation theorem for ordinary 
polynomials.) Let f be a continuous function on a closed interval [a, δ]. 
Then, given any € > 0, there exists a polynomial P such that 


If) — ΡΟῚ «ε 


for all x in [a, b]. In other words, a continuous function on a closed interval 
can be uniformly approximated by polynomials. 


The asserted result follows immediately from Theorem 10-15 and the fact 


that the mapping 
F(x) > rete + ὃ a 4.) 


establishes a one-to-one correspondence between C[—1, 1] and C[a, δ]. 


I] 


orthogonal series of polynomials 


11-1 INTRODUCTION 


In this chapter we continue the study of series expansions in Euclidean spaces 
by introducing three classic orthogonal series expressed in terms of polynomials. 
At the moment, of course, it is not at all clear that there is anything to be gained 
by using polynomials in place of trigonometric functions, and we shall have to 
ask the reader to reserve judgment on this point until we come to the study of 
boundary value problems. In fact, this entire chapter can be omitted without 
serious prejudice until Chapter 13 has been read, and even then it will be possible 
to continue with no more than a knowledge of Legendre polynomials and series 
(Sections 11-2 through 11-4). Nevertheless, the reader who pursues this dis- 
cussion to its conclusion will enhance his appreciation for the scope and subtility 
of the theory of orthogonal series, and will be that much better prepared for the 
material which follows. 

Before we begin, it may be appropriate to remark, once more, that our present 
investigations are a natural outgrowth of the ideas developed in the study of 
Euclidean spaces. Thus, although certain portions of the following discussion are 
technically involved, the issues at stake are simple and familiar. The student who 
keeps this point firmly in mind as he reads on should then be able to see the forest 
while among the trees. 


11-2 LEGENDRE POLYNOMIALS 


In Section 7-4 we applied the Gram-Schmidt orthogonalization process to the 
linearly independent set 1, x,x*,... in ΦΟΙ--Ἰ, 1] to obtain an orthogonal 
sequence of polynomials 


P(X), Pilx), pox), eae (11-1) 


As we shall see, these polynomials actually form a basis for Ge[—1, 1], and were 

it not for the complications involved in applying the orthogonalization process 

we could proceed directly to the study of series expansions relative to (11-1). But 

these complications do exist, and are serious enough to make it easier to start 
409 
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FIGURE 11-1 


afresh with a slightly different polynomial basis. This, then, is the reason for 
introducing the so-called Legendre polynomials—they are a basis for @C[—1, 1], 
and are reasonably amenable to computations. 


Definition 11-1. Let {P,(x)},n = 0,1,2,..., be the sequence of poly- 
nomials defined as follows: 

P(x) = 1, (11-2) 
and 


i oe Ly: (11-3) 


PrlX) = Fant χε 


forn > 0. Then P,(x) is called the Legendre polynomial of degree n, and 
(11-3) is known as Rodrigues’ formula for these polynomials.* 


It is clear from (11-3) that P, is a polynomial of degree n, and by direct computa- 
tion we see that 


Po(x) = 1, P(x) = x, 
P(x) = $x” — 3, P3(x) = χ᾽ — 3x, 
Pa(x) = 38x* — 48x? + ὃ, Ρι0) = χ' — χ᾽ + Abe. 


* This formula is also valid when n = 0, provided D® is interpreted as the identity 
operator. 
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(See Fig. 11-1.) Moreover, since all of the powers of x in (x* — 1)” are even, 
P», contains only even powers of x, while P2,4 contains only odd powers of x. 
This phenomenon is already apparent in the above list, and will prove useful as 
we continue. 

Before going on to establish some of the basic properties of the Legendre 
polynomials, we prove a general theorem concerning orthogonal sequences of 
polynomials in @@[a, Ὁ] which will serve to relate the Legendre polynomials 
to the polynomials in (11-1). The theorem we have in mind is an immediate conse- 
quence of the following lemma. 


Lemma 11-1. Let {R,(x)},n = 0,1,2,..., be an orthogonal sequence 
of polynomials in ΦΘΙα, b] indexed by degree (i.e., Ry, is of degree n). Then 
for each n, R,, is orthogonal in ΦΟ[α, δ] to every polynomial of degree <n. 


Proof. Let @m, denote the m-dimensional subspace of @C[a, δ] consisting of 
all polynomials of degree <m, together with the zero polynomial. Then, Ro, 
R,,..., Rm—1 15 an orthogonal basis for @,,, and every polynomial Q of degree 
<m can be written in the form 


Q = AG 9. Το ἘῚῚ Am—1Rm—~1; 


where 


Q-Re, , _ 
RoR? καο,.. 


ak = .5m— 1. 


Hence 
Q ᾿ Κι = ao(Ro ᾿ R,) ere tae On—1¢Rn—1 " R,); 


and since R,- R, = Oifk ¥ ἢ, it follows that O- R, = 0, as asserted. J 


Theorem 11-1. Let {Q,(x)} and {R,(x)},n = 0, 1,2,..., be orthogonal 
sequences of polynomials in @C[a, δ] indexed by degree. Then, for each n, 
Q, and R,, are scalar multiples of one another. 


Proof. Since Qo,..., Qn is an orthogonal basis for ®,44, 
Κι . Qo Rn Ἅ OF 4. Rn Rn + Qn 
R,(x) = oS Ps 
( ) Oo a Oo Oo(x) + O1 ᾿ O; Qi(x) τ TOO, On Q (x). 
However, by the preceding lemma, R, is orthogonal to Qo,..., Qn 1. Hence 
this equation reduces to 
Rn + Qn 
R(x) = — On° On Q,(x), 


and we are done. J 
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Among other things, Theorem 11-1 implies that, up to scalar multiples, 
@e[—1, 1] contains only one orthogonal sequence of polynomials {R,(x)} indexed 
by degree. Thus if each of the R, is chosen so that its leading coefficient is one, 
the sequence in question is uniquely determined. But these two properties are 
enjoyed by the polynomials in the orthogonal sequence (11-1) (see Exercise 16, 
Section 7-4), and we therefore have 


Corollary 11-1. The only orthogonal sequence of polynomials {p,(x)}, 
n= 0,1,2,..., in @C[—1, 1] with the property that py, has leading co- 
efficient one and is of degree n for each n is the sequence obtained by or- 
thogonalizing 1, x, x",.... 


Finally, if we accept the assertion that the Legendre polynomials are mutually 
orthogonal in @e[—1, 1], Theorem 11-1 implies that each P,, is a constant multiple 
of the corresponding polynomial in (11-1). This 15, in fact, the case, and we 
shall see later that 


Pol) = χα Pal), (11-4) 


a formula which gives a second possible definition of the Legendre polynomials. 


EXERCISES 


1. Use Rodrigues’ formula to compute the values of P1,..., Ps. 

2. Prove that Po» and P2,+1 are orthogonal in PC[—1, 1] for all m and nx. 

3. Use Rodrigues’ formula to prove that P; is orthogonal to P, in @C[—1, 1] for all 
n #1. 

4. Prove that if @C[—1, 1] has a basis ὦ consisting of polynomials, then ® must contain 
exactly one polynomial of each degree. Hence deduce that up to scalar multiples the 
sequence of polynomials given in (11-1) is the only polynomial basis for PC[—1, 1]. 


11-3. ORTHOGONALITY: THE RECURRENCE RELATION 


Our first task is to prove that the Legendre polynomials are mutually orthogonal 
in ©@[—1, 1]. To this end we begin by showing that P,, is a solution of a certain 
linear differential equation, a fact which in itself is of considerable importance.* 
Thus let (x2 — 1)” = w, and let w” denote the kth derivative of w. Then 


w) = Inx(x? — 1). ", 


* A direct proof of orthogonality can also be given along the lines suggested in Exer- 
cise 5 below. 
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and, multiplying by x” — 1, we have 
(x? — Dw? — 2nxw = 0. (11-5) 
Repeated differentiation of (11-5) yields 


(x? — lw’? - 2x(n — 1)w\? — 2nw = 0, 
(x2 — lw — 2x(n — 2w™ — 2[n + (nx — DW? = 0, 


(x? = 1»»νν. 19 Ὁ 2x[n a (k =e τυ 
Int (α -- 1) -Ἐ -τ- -Ἑ (α -- kv = 0. 


But since 
ἡ Ὁ (αι -- 1) Ὁ τ Ὁ ( -- ) τ 


(Exercise 7), this last equation reduces to 


(Qn — k)\k + 1) 
2 


(x? — 1)w%t® — 2χ[η — (k + DwET? — Qn — kk + lw™ = 0. 


We now set k = n, and observe that, by definition, 


w™ 


Pn = nal | 


Thus, if the above equation is multiplied by —1/2"n!, it can be rewritten 
(1 — ΧΡ" — 2xP) + n(n + 1)P, = 0, 
and we have proved 


Theorem 11-2. The nth Legendre polynomial P,, is a solution of the second- 
order linear differential equation 


(Ι[ — x*)y” — 2xy’ + n(n + Ἰὴν = 0. (11-6) 


It is not difficult to show that every polynomial solution of Equation (11-6)— 
which, by the way, is known as Legendre’s equation of order n—is a constant 
multiple of P,, (see Example 2, Section 6-5). Thus (11-6) characterizes P,, up to a 
constant multiple. Many treatments of the theory of Legendre polynomials start 
at this point, and define P,, as the polynomial solution of Legendre’s equation of 
order n which assumes the value one when x = 1 (cf., Theorem 11-5 below). 

Using (11-6) it is easy to establish the orthogonality of the Legendre poly- 
nomials in @C[—1, 1]. Indeed, starting with the pair of equations 


(1 -- x”)P!! — 2xP! + n(n + 1)P, = 0, 
(1 — ΧΡ; — 2xP, + m(m + 1)P,, = 0, 
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we multiply the first by P,,, the second by P,, and subtract to get 


( — χἹἋΡ,Ρ" — Ρ"Ρ.] — 2x[PmP, — P!.Pn] = PmP,[m(m + 1) — n(n + 1)]. 


(11-7) 
But the left-hand side of this equation is just the derivative of 


( — x?[PnPi — PhPn), 


and hence, integrating (11-7) from —1 to 1, we obtain 
1 1 
( — x°\PmPn — PmPn]| = [m(m + 1) — nm + 1) [ Pin(X)Pn(x) dx. 
=] —]j 
Finally, since 1 — x? vanishes at the upper and lower limits of integration, we have 


1 
[m(m + 1) — n(n + 1)] [ Pin(x)Pn(x) dx = 0, 
=| 
and thus, if m τέ ἢ, 
1 
[ Po(X)Pp(x) dx = 0. 
a | 
This completes the proof of 


Theorem 11-3. The Legendre polynomials are mutually orthogonal in 
ee[—1, 1]. 


We now anticipate the construction of series expansions relative to the Legendre 
polynomials by computing ||P,,||,n = 0,1, 2,.... Rather than attack this problem 
directly, we first derive an important formula known as the recurrence relation for 
the Legendre polynomials from which these values can be deduced without 


difficulty. 
Here we begin by considering the function ΧΡ, (χα), which is obviously a poly- 
nomial of degree n + 1. Thus, since Po, P1,..., Pn41, is an orthogonal basis 


for the subspace Φ,. 9 of @C[—1, 1], we have 
n+1 .Ρ 
χρ, ἡ = Σ᾿ ΣΡ: PAC, 


But, by Lemma 11-1, P, is orthogonal to every polynomial of degree <n, so that 
(xPn) + Px = δ," (xPx) = 
whenever k < n — 1. Hence 


(xPn)* Pn— 


1 (xPn)> Pr 
P,, ma .Ρ... owas i(x =F 


eae Pale) + Pet Py aC). 


xP,(x) = 
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This equation can be simplified still further if we note that xP,(x)? is an odd 
function (it contains only odd powers of x), for it then follows that 


: 2 
(ΧΡ...) Pn = [ xP,(xy dx = 0. 
=| 
This allows us to write | 
xP, = aPrsi + BPn—1, (11-8) 


where a and β are real numbers which we now propose to determine. 
In the first place, since 


P = εἰ. ΤΩ 2 1} 
w(x) π΄ Okkt dxk (x ye 
the coefficient of x* in P; is 
1 (2k)! 
Secondly, since 
οὐ — 1 = PF — th? ¢ ME 1) 2k-4 7 .,, 

the coefficient of x*—? in P; is 

cae eee _ (2k — 2) 

χερί k)2k -- 2) [2Κ —-(kK+ 1J = -- Wk - Dk Ξ DI (11-10) 


We now use (11-9) to compute the coefficients of x"! on both sides of (11-8) 
and equate the results, obtaining 


(2n)! [2(n + 1)]! 


2n(nly? — * 2e+if(n + IEP 
This implies that 


and (11-8) becomes 
n+ 1 
XP; = In pint + BP, 1. (11-11) 
To find β we use (11-9) and (11-10) to compute the coefficients of x"—! on both 
sides of (11-11), again equating results. This gives 


(2n — 2)! ntl Pat — 2 


7 7 21 — 1)}! 
n(n — Din — 2). ~~ In +1 2ntinkn — 1D! + Porte — Dp’ 
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which, after a little arithmetic, yields 
n 


πὶ 


We now substitute this value in (11-11) and solve the resulting expression for 
P41 to obtain 


Theorem 11-4. The (n + 1)st Legendre polynomial satisfies the identity 


_ 2n+ 1 n 
Pha = ame ΧΡ, -- Ἐπ τ [π--ἰ (11--12) 


for alln > 1, and all x. 


Remark. This result is also valid when n = 0 if we agree to set P_,(x) = 0. 


Equation (11-12) is known as the recurrence relation for the Legendre poly- 
nomials and can be used to deduce properties of P,., from those of the two 
immediately preceding polynomials. For example, given that Po(x) = 1 and that 
P(x) = x, we can compute P, from (11-12) by setting ἡ = 1. This gives 


P(x) = $x? a 
From this, and the known value of P;, we find that 


P3(x) = 3x(x* — 2) — 3x 


— Svea 3 
= 5X — 5x 


As a somewhat more substantial application of the recurrence relation we 
prove 


Theorem 11-5. P,(1) = 1 for all n. 


Proof. The assertion obviously holds for Po and P;. Moreover, if we assume that 
Po(1) = --- = Ρ,(ῦ = 1,2 1, the recurrence relation gives 


2n + 1 n 
Pol) = Td it~ 


I. 


The desired result now follows by mathematical induction. ἢ 


In much the same way it can be shown that P,(—1) = (—1)". 
We now use the recurrence relation to compute the value of ||P,||. Again a 
trick is needed, and this time it is furnished by the polynomial 


2n — 1 
n 


P(x) = Pp(x) — XP» —1(X). (11-13) 
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A simple calculation using (11-9) reveals that this polynomial is of degree less 
than n (see Exercise 8), and hence, by Lemma 11-1, 15 orthogonal to P, in 
ee[—1, 1]. Thus, if we multiply (11-13) by P, and integrate from —1 to 1 we get 


1 1 
| P,(x)” dx = = Ξ ι | XPy—1(X)Pn(x) dx. (11-14) 
= _ 


This is half of what we need. The other half is found by multiplying the recurrence 
relation by P,_; and then integrating. This gives 


1 1 
n 2, 2n+ a 
noe Ι. Ρ,.-.(Χ) dx = maa 1 Le xP p—1(X)Pn(Xx) dx. 


Thus, by (11-14), 


1 1 
27. nt | ; 
" Pr(x)* dx = πὶ}. Ρ,-,(χ) dx, 


or 
_ 2n— I 
~ n+ i 


!Ρ,}}" !Ρ,. 4", n= 1,2,... 


We now use the fact that [[Ρ0 ἡ = 2 to deduce that 


Pill? = 4-2 
Poll? = 2-4-2 


2n — 1 2n—3 2n — 5 l 


2 . eee 8 ϑὐσοσυις 
Pal 2n+1 2n—1 2n — 3 


and we have proved 
Theorem 11-6. ||P,,||? = 2/(2n + 1) for all n. 


By now the reader may suspect that the list of formulas involving Legendre poly- 
nomials is almost endless. It 15} But rather than continue the task of collecting 
them—interesting as that may be—we let matters rest where they are, and bring 
this discussion to a close with a theorem which will be of some importance in the 
following chapters. 


Theorem 11-7. The Legendre polynomial of degree n has n distinct (real) 
roots between —1 and 1. 


Proof. The assertion is obviously true when n = 0. Moreover, forn > 1, 


1 ] 
[ P,(x) dx = [ P,,(x)Po(x) dx = 0, 
—1 1 
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by orthogonality, and it follows that P,, must change sign at Jeast once in the interval 
—] < x < 1, and hence has a root in this interval. Now let x1, x2,..., Xm be 
the roots of P, in (—1, 1), and consider the polynomial 


O(x) = (x — χι)α — Χο) (ἃ — Xm). 


(Note that Q is of degree γι, with 1 < m <n.) Then since P, has no repeated 
roots (see Exercise 19), and since P, and Q change sign at the same points in 
(—1, 1), their product is either positive or negative throughout the entire interval, 
and it follows that 


i «Pal QQ) dx σέ 0. 


However, by Lemma 11-1, P,, is orthogonal to every polynomial of degree less 
than n, and hence would be orthogonal to Q were m <n. The preceding in- 
equality excludes that possibility, and forces us to conclude that m = n, as 
asserted. ἢ 


[Note: For convenience of reference we have summarized the essential information 
relating to the various polynomials studied in this chapter in tabular form at 
the end of the chapter.] 


EXERCISES 


1. Use the recurrence relation to compute P3 and P4. 


2. Prove that 
P,(—x) = (—1)"Pr() 


for all m, and use this result together with Theorem 11-5 to deduce that 
P,(—1) = (—1)". 
3. Compute Pe. 


4. Prove that 
P,(x) = [(2n)!/2"(n!)7]pn(x), 


where p, is the nth polynomial in the sequence (11-1). 

5. (a) Let (x? — 1)" = w, and denote the kth derivative of w by w™. Prove that 
w, WD). .., wD) all vanish when x = +1. 
(b) Prove that 


1 
| Pi(x)x” dx = 0 
al 


for every non-negative integer m <n. [Hint: Use integration by parts, and the result 
in (a).] 

(c) Use the result in (b) to deduce that the Legendre polynomials are mutually 
orthogonal in @C[—1, 1]. 


10. 


11. 


12. 
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. (a) With w and w™ as in Exercise 5, use integration by parts to prove that 


[ ᾿ ww” dx = (2n)! | ; (4 — x)" + x)" dx. 


(b) Prove that 


(n!)° n2n+l 
(2n)!(2n + 1) 


(c) Use the results in (a) and (b) to prove that 


1 
| P,(x)" dx = 
ey 


1 
[« — ΧΑ + x)" dx = 


2 . 
2n+ 1 


. Let & and n be non-negative integers with k < n. Prove that 


(2n — kk + 1), 
2 


[Hint: Use the formula 1 + 2 +°°: +2 = nv + 1)/2.] 


nap Dyer ss ae rk) = 


. Prove that P»(x) — [(2n — 1)/n]xPn—1(x) 15 a polynomial of degree < n. 
. Use mathematical induction to prove that the mth derivative of the product of two 


functions is given by 


nr 

n k —k 

(wy = DF (7) wor, 
k=0 


where 


n πὶ 
(i) = ae 
and uv = u,v = νυ, 
(a) Write 
1 1 


2 n,_2 (n+1) 
20 4+ 1) +1) πίνω —-1)@ -- 1) > 


Pra1(x) = 


apply Exercise 9, and then differentiate the result to obtain 


2 ie ope TE ees n+ 2 
ae ee eis a a 2 


Pryi = Pr. 


1 
2(n + 1) 
(b) Use the result just obtained and the differential equation for P, to prove that 
Phy = xP, + (n + 1), 


Differentiate the recurrence relation for P,,41, and use the result obtained together 
with that of Exercise 10(b) to prove that 


xP), — Pi_1 = mP,. 
Prove that 
(a) Phai — Pai = (2n + 1)Ph; (Ὁ) ( — x?)P, = nPp-1 — nxPy. 
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13. Establish each of the following results. 


1 
(a) | xP, (x)Pn—1(x) dx = aes n> 1 
—1 4n2 — 


1 
(b) [ κιωρίμω dx =2, π)ὲὼΡΌ 


1 
__*"_, 
(c) Ι. xPi(x)Pr(x) dx = ΠΗ n> 0 


14. (a) Use Exercise 12(b) and some other suitable identity to prove that 


2 
Χ ἘΞ ee 
n—1° 


P, = XPn-1 + 


(b) Replace n by n — 1 in the equation of Exercise 10(b), and square the result. 
Square the identity in 14(a), and use these two relations to establish 


1 pa Os ; 2 2 1 = x / 2 2 
ἋΣ [Ρ}] + ΙΡ.] = "2 ΙΡ.- 1] + [Pr—i] 


forn > 1. 
15. Use the result of Exercise 14(b) to show that 


1— 


2 
—— [Pi]? + (Pal? < 1 


whenever |x| < 1, and > 0. Now prove that 


|Pn(x)| < 1 
for all n if |x| < 1. 
16. (a) Let xo, x1, ..., Xm be m + 1 distinct numbers between —1 and 1. Find a 
polynomial Q;(x) of degree m which has roots at xo, ..., Xi—1, Xi4.1, +--+» Xm and 


takes the value a; at x;. 
(Ὁ) Let Q(x) denote the sum of the m + 1 polynomials Q;(x) obtained in (a). 
Show that O(x,) = a; for 0 < i < m, and then prove that no other polynomial of 
degree less than or equal to m has this property. 
17. Let F(x) be any polynomial of degree < 2m + 1, and let xo, ..., Xm be the roots 
of Pm41. Divide F(x) by Pmi1(x) to obtain 
F(x) = Pmii()P(x) + RQ), 


where P(x) is of degree < m, and R(x) is either zero or of degree <m. 
(a) Prove that 


Ve F(x) dx = is R(x) dx. 


(Ὁ) Prove that R(x) is the polynomial Q(x) constructed in Exercise 16(b) if a; 15 
taken as F(x;),i = 0, 1,...,m. 
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(c) Prove that 


1 
9 F(x) dx = >) τιΡαὺ, 


4=0 


where the constants 70, Z1,..., Im depend only on xo, X1,..., Xm, respectively, and 
not on any particular properties of F(x). 


18. Prove that there exists a positive constant M such that 


1 
M 
P,, dx «--- 
in (x)| dx ΤΙ 


for alln > 1. [Hint: Use the Cauchy-Schwarz inequality.] 


19. Prove that none of the Legendre polynomials has a repeated root. [Hint: Observe 
that any repeated root of P,, is also a root of P;,, and then use the uniqueness theorem 
for initial-value problems for second-order linear differential equations. ] 


11-4 LEGENDRE SERIES 


Now that we have established the orthogonality of the Legendre polynomials, it 
is only natural to ask if they form a basis for ®C[—1, 1]. The answer is that 
they do, and a proof of this fact will be given toward the end of the present section. 
For the moment, however, let us accept the truth of this assertion, and consider 
the series expansion of an arbitrary function f in @C[—1,1] computed with 
respect to the Legendre polynomials. By Formula (8-22), this series assumes 
the form 


and converges in the mean to f. Thus we are entitled to write 


οῦ 


f(x) = Σ ἢ δ" P,(x) (mean), (11-15) 
or, by Theorem 11-6, 
f(x) = > GnP,(x) (mean), (11-16) 
where " 
ics a i FGPG) hs ODE. τος (11-17) 


A series of this type is known as the Legendre series expansion of the function f, 
and the a, are called the Legendre or Fourier-Legendre coefficients of f. 
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EXAMPLE, Find the Legendre series expansion of the function 


=—d1,. =l-<x <0, 
fe) = | lL O<xé<l. 


Since fis an odd function on [—1, 1], so is f(x)Pan(x) for all n, and we have 
do, = 0, n= 0,1,2,.... 
Moreover, 
[FCP angio) de = 2 f° Pangiled de, 
and (11-17) yields 
Gon41 = (4n + 3) f Pon+1(x) dx. 
To evaluate this integral we write the differential equation for P, in the form 
[( — x*)Pr]}' + n(n + 1)P, = 9, 


and integrate from 0 to 1 to obtain 


AiG ΟΝ 
= ῥ᾽ (0). 


1 
n(n + 1) f P,,(x) dx 


But, by Exercise 12(b) of the last section, 
Pr(0) = nPn_1(0), n> 0, 


and we therefore have 


1 
l 
Ι P,(x) dx = way PaO), n> 0. 


Hence 


oh t= Pan(0), OTe. 


Aan+i = γα + 1) 
Finally, since 


Po,(0) = (—1)"4 


no Ὁ 5 Ὁ ἐς (25 5.1} 
2-4-6:-:- (2η) 
(Exercise 2 below), 


—_ 3 
Qa, = 5. 


- ip Me t3 3:5 Gn = 1), 
dents = (1) FG - ἢ) 2:-4-6:-- (Qn) 
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and we have 


f(x) = $Pi(x) — Pa(x) + P(x) — τ ΈΡτ(Χ) + - 
= .3.5 2n 
= 9x + 2, (-- 1)" τ ἘΞ + ἴτ᾽ [350A Dp 


In general, the theorems describing the convergence of Legendre series are 
similar to the corresponding results for Fourier series, and are proved in much 
the same way.* Without going into the details here (see Section 11-5), the basic 
result in this connection reads as follows. 


Theorem 11-8. The Legendre series for a piecewise smooth function f in 
@e[—1, 1] converges pointwise everywhere in the (open) interval (—1, 1), 
and has the value 


f(x") + fo) 
2 


at each point in the interval. Moreover, the convergence is uniform on any 
closed subinterval of (—1, 1) in which f is continuous. 


This said, we now turn to the one major item of unfinished business—a proof of 
the fact that the Legendre polynomials form a basis for ΦΟί-- 1], 1].f Again the 
most important step in the proof is furnished by the Weierstrass approximation 
theorem, phrased this time for ordinary polynomials. 


Theorem 11-9. Let f be a continuous function on a closed interval [a, b], and 
let € be a positive real number. Then there exists a polynomial p such that 


f(x) — pQx)| < «€ 
for all x in [a, δ]. 


More succinctly, Theorem 11-9 asserts that any continuous function on a closed 
interval can be uniformly approximated by polynomials. Properly interpreted, 
Fig. 9-24 furnishes a suitable illustration of this result, and a proof can be found 
in Section 10-8. 

For simplicity we now let £ denote the set of all Legendre polynomials. One 
of the implications of Theorem 11-1 is that £ spans the same subspace of 
@e[—1, 1] as the set 1, x, x”,..., from which it follows that 8(£) is the subspace 
of ΦΟΙ--Ἰ, 1] consisting of all polynomials. Thus S(£), the closure of S(£) in 


* In fact, it can be shown that the Legendre series for a function converges pointwise 
in the interval (—1, 1) if and only if its Fourier series does. 

+ The following argument makes use of the results in Section 9-7, and should be omitted 
by those who are unfamiliar with that material. 
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@C[--1, 1], must also contain all polynomials. This fact, combined with the 
Weierstrass approximation theorem and Theorem 9-5 will allow us to show 
that every function in @C[—1, 1] is the limit in the mean of a sequence of functions 
in 8(.C), which, of course, will prove the basis theorem. 

Indeed, if fis a continuous function in @C[—1, 1], Theorem 11-9 provides a 
sequence of polynomials {Q;}, k = 1,2,..., (the subscript does not indicate 
the degree of the polynomial this time) such that 


Ι 


f(x) -- Ο(ΟἹ < Vik 


for all x in [—1, 1]. But then 


If — Ομ] = Ce [f(x) — Qx(x)]° aye 


2 τ τος A 
and we conclude that {Q;} converges in the mean to f. Hence 8(9) contains all 
continuous functions on [—1, 1]. 
Finally, let g be any function in ΦΟΙ --Ἰ, 1]. If g is not continuous we apply 


Theorem 9-5 (modified in the obvious way) to obtain a sequence of continuous 
functions {g,},k = 1,2,..., such that 


Ι 
lle -- eel < ap 


Since each g; is continuous we can apply the preceding argument to find a poly- 
nomial Q;, such that 


lex — Οἱ] < ὦ" 


Hence 
lg — Ομ = ᾿(ᾳ — gx) + (gn — Q:)I| 
< lle — gull + llgx — Ομ] 
1 l 
=F OR 
Zs 
k 


and the sequence of polynomials {Q;} converges in the mean to g. Thus g also 
belongs to $(£), and we have proved 


Theorem 11-10. The Legendre polynomials form a basis for the Euclidean 
space @C[—1, 1]. 
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EXERCISES 


1. What is the formula for the Legendre series expansion of an even function in 
@e[—1, 1]? Of an odd function? 
2. Prove that P2,41(0) = 0, nm = 0,1,2,..., and that 
n1°3°5:::(Qn — 1) 
nO) = (—1) -------------- ---: ΞΕ 
P2,(0) = (—1) τε Οἱ n=] 


3. Find the Legendre series expansion of the function |x| in @C[—1, 1]. [Hint: Use 
integration by parts and Exercise 12(a) of the preceding section to evaluate the 
coefficients. | 


4. Prove that P, = (2n — 1)Pp—1 + (2n — 5)Pn-3 + (Qn — es _5 +:--, for all 
n > 1, by expanding P;, in a Legendre series. 


5. Find the Legendre series expansion of each of the following functions in @C[—1, 1]. 
(a) x? (Ὁ) χῦ — x3 + 2 (c) 4x*# + 2x2 — x 
6. Find the Legendre series expansion of the function 


1 —-l1<x <0, 
foo =| 
0, 0O<x<l. 


*11-5 CONVERGENCE OF LEGENDRE SERIES 


We conclude our discussion of Legendre series by proving the convergence 
theorem cited in the preceding section. As with the proof of the corresponding 
result for Fourier series, we begin the argument by deriving a formula for the 
partial sums of the series in question. 

Thus let f be an arbitrary function in @C[—1, 1], and let 


Sr(x) ma 3 arP,(x), 
k=0 


where 
a, = “AHS i: ΚὺΡι(ὺ dt. 
Then 
5,0) = Σ᾽ ἘΞ: [. f(O)P x(t) au Py(x) 
k=0 
1 
mm | Σ et Porn} fa) dt 
—1l} καθὸ 


/ ; K,(t, x) f(t) dt, 
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where 


Kt, x) = δ) ES! ppp. 


k=0 2 


To put this expression in more manageable form, we rewrite the recurrence 
relation for the Legendre polynomials as 


(2k + W)xP.(x) = (K + 1)Pe4i(&) + ΚΡ. 1(.), 
and multiply by P(t). This gives 
(2k + I)xPr(t)Pr(x) = (Κ + Π)Ρι(Ρὰ.1(Χ) + ΚΡι(ΏΡι.- τ. (11-18) 


We row interchange the roles of x and ¢ in this expression and subtract (11-18) 
from the result to obtain 


(2k - 1)(t — x)Pi(Q)Pe(x) = (K - DPe41@ Pex) — Pr(t)Pr410)] 
—k[P,(t)P.—1(x) — δὲ. (Ὁ ΡΟ )Ἐ[. 


Finally, summing this identity as k runs from 0 to n, we find that 


( -- x) δὴ 2k + DPPH) = (αι + Pa τ, — Ρμ(ΏΡ,. 10, 
k=0 


Or 


Κ,(, x) = nN τ Ι [Pc ἜΞΣ a(DPats)| : ( 1-19) 


P=" X 


a formula which is known as Christoffel’s ἀρ 
In particular, we now have 


S,(x) = δ εἴ Pat Pa) - μόλε 49 dt. (11-20) 


Lx 


Moreover, since S,,(x) = 1 for all nm when f(x) = 1, (11-20) also implies that 


1 
n+ If Pui(@)Pn(X) — Prit)PnsX) gy -- 1 (11-21) 
2 oer i—x | 


The two formulas just derived allow us to express the difference between S,(x) 
and /(x) in integral form. The following lemmas will enable us to show that this 
difference approaches zero with increasing n whenever fis reasonably well-behaved, 
and therefore play the same role in the present argument that the Riemann- 
Lebesgue lemma played in the study of Fourier series. 
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Lemma 11-2. Jf g is an arbitrary function in PC[—1, 1], then 


1/2 


[ ᾿ 85(Χ)Ρ, (Χ) dx| = 0. (11-22) 


lim n 


ne 


Proof. Applying Parseval’s equality to the function g, we have 


[aca ax = Sp τ τ 
ΞΕ | n=0 ἴω P,,(x)” Ὡς 


| 
Ms 
fa 
ie 
30 
“ς΄ 
ὃς 
Neue” 
bo 
2. 
ae 
ΜΝ 
sh 


Ι 
Ms 
Son 
RO 
3 
4) 
YZ 
iS 
sn 


Thus the series 


Hence 
1 

7. ἢ» sae a 

bay (5.2.5) Ια, = him ( 5 Ξ 5(Χ}Ρ,(χ) dx| = 0, 
which, in turn, implies the desired result. J 

Lemma 11-3. There exists a positive constant M such that 

M 
|Pr(x)| < (11-23) 


nil2(] — x2)1/2 


for alln > 0, and all x in the interval (—1, 1). 


The proof of this inequality is long and somewhat involved. Hence, rather than 
run the risk of obscuring our present argument, we have deferred the proof to 
the exercises where sufficient directions have been given to enable the student to 
work the details through for himself. 

Now let fbe an arbitrary function in PC[—1, 1], and let x9 be a point in the open 
interval (—1, 1) at which fis continuous and has a right- and left-hand derivative, 


1.6., a point where 
lim Κὴ — fo) and lim f(t) — f(xo) 


toate [ — Xo tro t — Xo 
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exist. Then (11-20) and (11-21) imply that 


SG -- χο - ἢ "τὶ £0) ~ = So) [Pr41()Pn(x%o) — Pn(t)Pn41(xo)) at 


—1 Γ ΞϑΞ Χὴ 


a lp (x of AO Ξ IC) p Ρ, ετ(ἢ dt 


say ee [ fa) = = £69) p P,(t) dt 


But, by Lemma 11-3, there exists a constant M such that, for all n > 1, 


n+ 1 M n+ 1 
τς Palo) < 2(1 — x2)172 pe 


DA OMSL 
= 2( — x2)1/2 ni? 
= Kn'!?, 


where 
K = ΜΑΙ — x?)"/?. 


Moreover (and this is the critical point in the argument), the assumption that f 
has a right- and left-hand derivative at xo implies that the function 


JO πως.) φὰς 


ΐ -- Xo 


belongs to ΦΟΙ --ΙἸ, 1]. Hence, by Lemma 11-2, 


τ amy NG of f(t) — I) — ΕΟ p i(t) dt 


Da ἘΞ ft — ΧΟ 
« K lim in| [ LO = £09 p μα at 
= Q, 
Similarly, 


lim 


n—->% 


0, 


ar a LO — SF Lo) p (ἢ) dt) = 


and we have therefore shown that 


lim |S,(Xo) τὴς f(xo)| = 
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completing the proof of 


Theorem 11-11. The Legendre series for a function f in ©C[—1, 1] con- 
verges to the value f(x 9) at each point Xo in the open interval (—1, 1) where 
f is continuous and has a right- and left-hand derivative. 


In addition, it can also be shown that this convergence is uniform whenever / is 
continuous. Specifically, we have the following theorem. 


Theorem 11-12. The Legendre series for a function f in @C[—1, 1] converges 
uniformly to f on any closed subinterval of (—1, 1) in which f is continuous 
and piecewise smooth. 


We omit the proof. 

To complete the argument leading to Theorem 11-8 we must now determine 
the behavior of the Legendre series at a point of discontinuity of f/ To this end 
we first prove the following rather surprising result. 


Lemma 11-4. Let xo be an arbitrary point in the open interval (—1, 1). 
Then 


x9 
ia n+ 1 | Pn4i(t)Pn(X0) — Pa(t)Pn4i&%o) ΞΕ 
2 =i t= X6 


bol 
we 


and 


bol 


1 
tim 2 | Pn4i(t)Pn(xo) -- Pn(t)Pnii%o) 4, -- 


0 t— Xo 


Nw 


Proof. We begin by computing the Legendre series expansion of the function 


ae l —I1<x < Xo 
Ke) ΞΘ = ’ 
Ie) : Xo χε 1. 


Since 
] 
P,(x) = n+ [Pr+4i(x) — Py_1(x)] 


for all > 1 (Exercise 12(a), Section 11-3), the general coefficient in this series is 


ΠΝ te 
i = “3 2 P,,(x) dx 
-1 


i | Phas) — Pha a 


= HPn41(%0) — Pa—i(%o)] — 3fPn4i(—1) — Pr—i(-1)] 
= $[Pnii(%o) — Pn—1(%o)]; 


the last step following from the fact that P,(—1) = (—1)”. 
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Moreover, 


το 


Hence the Legendre series for fis 


Pi(Xo) 


1 7 + ; >> [Pn41(Xo) ἬΝ Ρ,--1(Χ0}}, Χ), 
n=1 


5 + 


and it follows that the value of the mth partial sum of this series at the point xo is 


S,(Xo) = : Ἔ Piro) + ; 3 [Pi41(%0) — Pr_1(X0)]Px(%o) 
ct 


= § + 3Pn41(%0)Pn(Xo). 
But by (1 I-20), 


xo 
1 Fe t Py =. P,, t Pr 
HCE n τ Ι. «τ(ῇ ΕΝ τ (t)Pn+41(%o) ὧι. 


Hence, by (11-23), 
Ζ0 
fim 2+! | Puti(@)Pn(Xo) — Pn(t)Pn+10%o) ἡ 
NO —1 aa sa 
= 8 -- £lim Py 44(x0)Pa(%o) 
1 
2 


This proves the first statement in the lemma, and the second follows by sub- 
tracting this result from (11-21). J 


Now let f be any function in @C[—1, 1] with the property that 


+ eS 
foxy = τ. 


for all x in (—1, 1), and let xg be any point at which γι has a right- and left-hand 
derivative. Then, if S,(x 9) denotes the value of the nth partial sum of the Legendre 
series for f, (11-20) implies that 

Sr(xo) = 1 + Le, 
where 


A + l es Pn4i@)Pn(Xo) a Py(t)Pn+1(Xo) f(t) dt, 
2 | i — Xo 


1 
po AE [sO = ROFL ang 


0 
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Thus | 
ng Ἔ 
Sr(xo) -- fo) = E = fe) + Ε — is) | ; 
and to prove that 


{ππιὶ [5,.(Χ0) — 70Χ0}} = 


it suffices to show separately that 


iii E = fea) aie E 7 fi) =o: 


No no 


By the preceding lemma, 


SOD) ὡς 2+ ᾿ Ρ, μα(Ρ, (00) -- Pn(t)Pn41(%o) 
πῇ 


{— Xo 


f(xo ) dt, 


fom, 2 


whence 


= jim 1 1, LO - fC) ip WyPa(xo) — Pa()Pn4iC%o)] at. 


no 2 an | t— Xo 
Now let 
f(t) — fo) 
g(t) = ie —LSt< Xo, 
0, Xo < it < ie 


Then, since f has a left-hand derivative at xo, g is piecewise continuous on [—], 1], 
and we have 


N—>00 2 


1 
lim are Ι. g(t)[Pn410)Pr(xo) = Pr(O)Pn41(%o)] dt. 


γ..--}ὸ 


We now repeat the argument leading to Theorem 11-11 to deduce that 


Finally, by introducing the function 


0, -1«|-ς Xo, 


f= $8), cre, 


A(t) = 
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and reasoning as above, we also find that 


NO 


thereby proving 


Theorem 11-13. The Legendre series for a function f in @C[—1, 1] con- 
verges to the value 


fxd) + feo) 
2 


at each point Xo in the open interval (—1, 1) where f has a right- and left- 
hand derivative. 


EXERCISES 


1. During the proof of Lemma 11-2 it was asserted that if 


2n+ 1 Me ; 
im ( 5 ) g(x)P,(x) dx| = 0, 
nN —>00 --]} 
then 
1 
, 1/2 
lim n | g(x)Pn(x) dx} = 0. 
n—-0 --1 


Why is this true? 
2. At what point does the proof of Theorem 11-11 break down if f has a Jump discon- 
{λυ at xo? 


The following exercises furnish a proof of Lemma 11-3. 
3. For each integer n > 0, let 


flx) = : : [x + (x? — 1)"*cos φ]" de. 


(a) Show that fo(x) = 1 and fi(x) = x. 
(Ὁ) Show that 


(n + 1)fr4i(x%) — Qn + 1)xfp&) + nfr—-1@) 


= a {=n — 1)sin?¢ + (x? — 1)? cosglx + (x” — 1)" cos gl} 
0 


x Ix αὖ — 1)" cos g]" de. 
(c) Use integration by parts with 


u= [x + (x? — 1)! cos¢g]", dv = cosedy 
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to prove that 
i: (x? — ἢ" cos φίχ + (x? — 1)'? cos ¢]” ἐφ 
0 
Ξ [πο — 1)sin? gfx + (x? -- 1)" cos φῦ “ dy. 
0 


(d) Use the results of (a), (b), and (c) to deduce that 


Ἂν ᾿ 
P,(x) = = Ι Ix + (x? — 1)’ cos φ]" de. 


. (a) Rewrite the formula in Exercise 3(d) as 


P,(x) = : Ι [x + i — x*)'!” cos oy" de, 


where i = «/—1, and show that 


|P,(x)| < : | (cos” y + χ sin” ¢)"”” dg. 
0 
[Recall that if z = a + bi, then |z| = (α2 + 67)!/7,] 
(b) Use the result of (a) to prove that 


|P n(X)| <1 
for all m and all x in (—1, 1). 
(c) Show that the inequality in (a) can be rewritten 


w/2 
2 ; n/2 
[Pa(x)| < = [ [1 — ( — x”) sin? gl”? do. 


[Hint: The graph of sin ¢ is symmetric about the line g = 7/2.] 

(4) Prove that sing > 2¢/zm for0 < ¢ < 7/2. 

(6) Set μ = (2/x)(1 — x”)!/2, and use the inequality in (4) to deduce that 
1— (1 — x*)sin?¢ < 1 -- μέρ, 0 “ρ < w/2. 

Then use (c) to prove that 


w/2 0 
2 —nu*p?/2 2 / = 72 
P,(x)| < = | e dpe <—=s- | ε “αἱ. 
| estes Os ΤΣ; 


(Ὁ Now use the fact that 
/ — 17/2 
6 dt « ὦ 
0 


to conclude that there exists a positive constant M such that 


M 
IPr)| < nz] — x2)1/2 


for ally > 1 and all x in (—1, 1). 
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11-6 HERMITE POLYNOMIALS 


We now know a great deal about the behavior of polynomials in the Euclidean 
space @C[—1, 1], all the way from some very special properties of the Legendre 
polynomials to the central result which states that the orthogonalized sequence 
obtained from 1, x, x”,... is a basis for the space. In point of fact, however, the 
essential portions of our earlier discussion remain valid over any finite interval 
[a, δ], and thus, for theoretical purposes at least, we need not consider the ap- 
parently more general space @C[a, b]. But when we come to study piecewise 
continuous functions on the entire real line, (— οὐ, o), the situation becomes much 
different, and requires special consideration.* 

In the first place, if f and g are arbitrary piecewise continuous functions on 
(— οο, 0), there is no guarantee that the improper integral 


Γ᾽ fe) 900 de = lim ic Fae) de (11-24) 


b- 00 


converges. Indeed, (11-24) is undefined even when fand g are polynomials. Thus 
our usual definition of an inner product is not valid, and this, in turn, implies that 
if we wish to use the general theory of Euclidean spaces in this context we must 
either consider another set of functions, or another inner product, or both. 

As our point of departure, let us insist that any function space which we consider 
contain all polynomials, and that its inner product be defined by means of an 
improper integral over the entire real line. This being the case, it is clear that 
we must introduce a weight function w into our integral in order to guarantee that 


[΄- #@)p@)q@a) dx 


exists for every pair of polynomials p,q. (See Example 3, Section 7-1). This 
requirement suggests that w be piecewise continuous on the entire real line, and 
that it tend to zero as |x| — «. Moreover, it is convenient to require that 
lim) 2} 50 W(x)x” = Ο for any positive integer 2. (Why?) Our experience from 
calculus suggests that we try an expo- 
nential function (with negative exponent), 
and since we allow x to assume negative 
as well as positive values, the exponent 
should involve only even powers of x. 
Thus we are led to try the weight function 


w(x) = ev? !2, (11-25) FIGURE 11-2 


* A function is said to be piecewise continuous on (— ©, 0%) whenever it is piecewise 
continuous on every finite interval [a, 5]. 
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(See Fig. 11-2.)* The following lemma guarantees that this choice will be 
successful. 


Lemma 11-5. Let In, = [ἢ e7” 2x" dx, n = 0,1,2,... Then 


Ton4+1 = 0, 
2n)k α- 
Ton = ) / 20 


for all n. 


Proof. We begin by considering 


b 2 
Tongi = lim [ ga ges" dx. 
--α 


a—0o 
bo 00 


In this case the integrand is an odd function of x, and hence 


b 2 a 2 ὃ 2 
[ ο΄ Ὁ 12)2n+1 = | et 12,2n+1 yy a [ ας /2).2n+1 yy. 
—a@ a 


--α 


ὃ 2 
9 ett de. 
a 


But 


b 2 b 2 
[ ΧΕΙ, Σ [2 dx ass [ x2"(xe~* 3) dx 
a a 


21515 b 2 
= xe τ 5 Ὁ 2η[ Rema 1 dx. 
a a 


Thus 


2 
Lon41 = lim [=e re 
a—r@ 
b—»00 


b b 2 
+. 2n[ gens t ge dx| 
a a 


b 2 
= 2n lim x22 —le—7 12 dy 
aw a 
b-— 00 


Ι 


α 2 b 2 
2n lim | / Op Ὁ 12 ἂχ -Ἐ [ ΧΡ} dx| 
a—00 --α α 
b—00 


* Some authors set w(x) = ο τ΄, Except for the obvious modifications this necessi- 
tates, all of the results in this section still remain valid. However, the Hermite poly- 
nomials defined below then do not have 1 as their leading coefficient. 
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and it follows that Joni, = 2nJon_, for all n > 0. Moreover, by direct compu- 
tation, we find that 7; = 0. Hence J2,,, = Ofor all n > 0, as asserted. 
To evaluate Jy, we must use the fact (proved in Exercise 3 below) that 


0 = [ et 13 dy = V/2n. 


--οὦ 


Then if n > 0, 
71... ΞΞ [ χππιζχε τ 12) εἶχ 


b b 
lim [= cies a + (Qn — 1) xen 29-2 12 dx| 


ae = ie 
oo (Qn r, 1) Ion—2. 
Hence 
I = (2 _ 1) V2n, 
Ion = (Qn — 1)Qn — 3)°--Q — I) ν 2π. 
But | 
(Qn — 1)(Qn — 3)---ΩὩ -- 1) Ξ (5) ifn > 0, 


and the lemma is proved. ἢ 


From the way things are developing, it is obvious that we stand in imminent 
prospect of having to consider various integrals of the form 


[ «θεὼ de. 


This being so, it will be well to dispose of convergence questions once and for all, 
which we do by proving 


Lemma 11-6. Let f and g be piecewise continuous on (—o, ©), and 
suppose that 


| et lH) 2 dx <  αμά | ° HBB o(x)? dx < oo. 
Then 
(i) Ἂ ee ΚΑῚΣ dx < ὦ forall real a; 
(ii) f “τ I(x) 4 g(x)P dx < ὦ; 


(iii) f πε ἡ 24x) 9(x) dx < 0. 
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Proof. The first result is obvious, since 
wo 2 οΌ 2 
[ eo Πα f(x)P dx = a? i e* !2 (x)? dx. 


To prove (ii), we introduce the function max (f, 5) which, for each x, is de- 
fined to be the larger of the two numbers f(x), g(x). It is clear that max (f g) is 
piecewise continuous on (—, o) (see 
Fig. 11-3) and, in addition, that _ max (7.5) 


[f+ 651 < [fl + [51 
< [2 max (||, [4}}}" ‘i 


1b 
| 
= 4max (f”, g”) 
g 
< 2 2 
S 4 + al ᾿ FIGURE 11-3 


Thus 
[7 PPG) + soo? dx < 4{ εὐ fox? ax 


i) 2 
+4 [ ε΄ Ὁ |? a(x)? dx. 
By assumption these last two integrals are finite. Hence 


i ° eT Ax) + g(x)? dx < o. 


—" 


Finally, since 


κώκο - VOD + OOF ΚΡ + κοῦ’, 
Ι. oT Feet) de = is e* PLAX) + gol? dx 
ΞΕ. af” en? 13.) ΓΞ af ΠΝ ” 


But we now know that all of these integrals are finite, and we are done. J 


These technical details out of the way, we consider the set of all piecewise con- 
tinuous functions on (— οὐ, οὐ). identified in accordance with the convention in 
Section 9-2, which have the property that 


[ eB IHX)? de < ow. (11-26) 


This set will be denoted by 9%, the subscript serving as a reminder that /?, 
rather than f| appears in (11-26), the superscript recalling that a weight function 
is involved, and g standing for “‘integrable.’”’ The functions in 35 are sometimes 
referred to as being ‘“‘square integrable with respect to the weight function e~* /?.” 


438 ORTHOGONAL SERIES OF POLYNOMIALS | CHAP. 11 


Theorem 11-14. 45 is a Euclidean space under the usual definitions of 
addition and scalar multiplication of piecewise continuous functions, and 
inner product 


ΓΞ le. e—* 2 F(x) (x) dx. (11-27) 


Proof. From Lemma 11-6 we know that f + g and of belong to 9% whenever 
f and. g do, and also that the integral defining /- g is finite. This disposes of all 
but the straightforward details in the proof, and these we leave to the reader. JJ 


With this, we have realized our goal of constructing a function space on (— 0, «) 
which contains all polynomials, and also, by the way, all bounded piecewise con- 
tinuous functions. [For if fis such a function, then 


οο 2 fea) 2 
[ οἴ |? Ax)? dx < ΜῈ e* 2 dy = ΜΝ 2 < «.] 
Moreover, our patient insistence on keeping polynomials in view is now rewarded 
in the form of the following basic result. 


Theorem 11-15. 9% is the set of all piecewise continuous functions on 
(— οὐ, 0) which can be expressed as limits, in the mean, of sequences of 
polynomials. Hence, if f is an arbitrary function in $5, there exists a sequence 
of polynomials {p,\,n = 0,1,2,..., such that 


lim [0 — Pall = lim ({ e-*7LA%) — pa) dx)? = 0. 


The proof is difficult, and will be omitted. 

From this point the discussion proceeds very much as with Legendre poly- 
nomials. Indeed, the sequence 1, x, x”,... is linearly independent in 93 (Exercise 
6), and can be orthogonalized by the Gram-Schmidt process to produce a basis 


Pol(x), pi(X), ..., Pn(X), ... 


in which p, is a polynomial of degree n. (This is one of the consequences of 
Theorem 11-15.) But again this particular basis leads to computational diffi- 
culties, and since Theorem 11-1 holds, mutatis mutandis, in this situation, we are 
free to seek another basis composed of polynomials, one of each degree. This 
time the most convenient basis consists of the so-called Hermite polynomials, 
which are defined by the formula 


H,,(x) = (γε 8 Se, n = 0,1,2,... (11-28) 


By direct computation we see that 
H(x) = 1, A,(x) = x, 
H.(x) = x? — 1, H3(x) = x° — 3x, 
H,(x) = x* — 6x? +3, 9 As(x) = x? — 10x? + 15x. 


11-6 | HERMITE POLYNOMIALS 439 


The fact that H,, is a polynomial of degree n with leading coefficient 1 can be de- 
termined by inspection of (11-28), or by the technique suggested in Exercise 5. 
An even more obvious remark is that H2, is even, and H2,4 1 odd, for all ἡ. 


Theorem 11-16. The Hermite polynomials are an orthogonal sequence in 
95 with 
[Η,|3 = ntv/2r. (11-29) 
Proof. Let 


᾿Ξ | ε΄ 257 ΑΗ, ΑἹ dx 


Μ᾿ ον οἷ 
= (-1) [ Hy(x) τς (ε΄ |) dx, 


and assume that m <n. Integrating by parts, we obtain 


n—l1 


I= ἢ" | Hx) fer) 


oa) re) qr} ae 
πως ἊΝ A(x) ea (e γα. 
But the first term in this quantity is the product of a polynomial and e—*’/?, and 


hence vanishes as |x| — oo. Thus 


n—l 


ae ἢ Go pt 
r= (19? [. Hix) Fa Ce '2) dy, 


We repeat this procedure a total of m times, and get 


οΌ 


rayne [ πρῶ ΕΞ 


adxn—-m 


(e~* |?) dx, 


where HS denotes the m-fold derivative of H,,. But Hi” = ml, since H,, is a 
polynomial of degree m and leading coefficient 1. Hence 


= na—m 2 
I= ἢ —_ (ε “ 2) dx. 
Now suppose m « π. Then 
m+n cate —z"/2 7 
[= (-- Ὁ μη © ᾿Ξ 
= ἢ, 


since this quantity is also the product of a polynomial and e~*/?, Thus H,, and 
H,, are orthogonal in 95 whenever m =~ ἢ. 
Finally, if m = ἢ, 


] - (- λ΄ et 13 dy 
niv/ 27, 


I 


and the theorem is proved. ἢ 
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One of the principal reasons for the importance of Hermite polynomials is that 
they appear as solutions of a certain linear differential equation. To derive this 
equation we first establish the following recurrence relation. 


Theorem 11-17. The Hermite polynomials satisfy the identity 
Anay = ΧΗ͂, — nHy-1, n> 0. (11-30) 
(This identity is also valid for nm = Ὁ if we agree that H_,; = 0.) 


Proof. The proof is similar to the one given in Section 11-3 for the Legendre 
polynomials. Since xH,,(x) is a polynomial of degree n + 1, its Hermite series is 
of the form 


Ἐπ ΧΗ, Ἢ, 
xH,(x) = δ᾽ Ξε i H,(x). (11-31) 
k=0 


By Lemma 11-1, which is also valid in the Euclidean space 553, we have xH, + Hy = 
A, xH;, = 0 ifk <n — 1. Moreover, 


00 2 
xH,,: H, = [ χο ! ?H,(xy* dx 
ξ ἢ 


since the integrand is an odd function (see Lemma 11-5). Thus (11-31) ts of the 
form 


xH,(x) = any, 4 1(X) a Bn, —1(X). 


If we equate the coefficients of x"! in this identity, and recall that the leading 
coefiicient of Hj, is 1, we see at once that a, = |. 
Rather than equate coefficients to obtain B,, we reason as follows. Since 


ΧΗ͂, + H 
a a Ee] 


A+ ὰ A414 
for all ἡ, it follows that 


XH, Ay = Anal? = VJ 24 (n + 1)!. 


But then 
gS ΣΡ ΜΒΝΞΙ, 
dg ® a 
Ν V/ 2x n! - 
— ΜΖπᾳπ -- 1)! 
Thus 


ΧΗ, 5: n+1 + nH, _1, 
as asserted. J 
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To derive the differential equation we start with the defining formula for H,,: 
Ee; ον, τς 
— (_1\%,% 2 α΄ [2 
H,(x) = (—1)"e dan © : 


This may be rewritten 
d” 


a e2 6 __ π΄ 
Fae? = (-1)'e* PHC), 


and, when differentiated, gives 


Lite νὰ, = (—1)"[-xAn() + Hi(oje7* 13 
On the other hand, 
ΓΝ π᾿ 
Thus 


n+ = xH,, = HY, (11-32) 


a relation which is sometimes useful in itself. 
The recurrence relation and (11-32) together give 


H! — nH,_, = 0, 
or 
Hay — (n+ 1H, = 0. 


We now differentiate (11-32) to get 

nti = ΧΗ + An — Ay, 
and it follows that 

Ay! — ΧΗ + nH, = 0. 


Thus we have proved 


Theorem 11-18. The Hermite polynomial of degree n is a solution of the 
second-order linear differential equation 


γ' — xy’ + ny = 0. (11-33) 


As with the Legendre polynomials and their differential equation, it can be shown 
that ἢ, is the only polynomial solution of (11-33) with leading coefficient 1. We 
shall encounter this equation again in Chapter 13 when we discuss the Schrodinger 
wave equation from quantum mechanics. 
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EXERCISES 
1. Determine whether or not the following functions, defined on (— ©, «), belong to 
G2. 
(a) ew /4 (b) x sin x () |a| (ὦ fQ)=nn<x<nt1 


In |x|, |x| > 1 
0, |x| < 1 
2. Prove that lim),;,. p(e7? ! 2 = 0 for any polynomial p. 
3. Let = f%, ε τὴ!2 dx. Then 


00 2 00 2 
1 ([ eu dx) (f e ” dy) 
0 ποῦ 2,2 
J [ ἔπ +y°)/2 dx dy. 


Change to polar coordinates, evaluate this integral, and thus show that 1 = ν΄2π. 
4. Prove that 


(e) χε "8 (f) f(x) = | (g) e” 


Ν (2n)! 


(Qn — 1) (Qn -- 3)---@-D= 3 


[Hint: Use mathematical induction.] 


5. Given that Ho(x) = 1, use (11-32) and mathematical induction to prove that 
H,,(x) is a polynomial of degree n with leading coefficient 1. 


6. Prove that the functions 1, x, x”, ... are linearly independent in 92. 


7. (a) Use the recurrence relation to verify that the polynomials listed in the text as 
Ho,..., Hs are correct. 


(b) Compute Hg and A7. 
8. Prove that 
He2n+100) = 0, and Ho,(0) = (—1)"1-3-5-++ Qn — 1) 
for all 7. 
In Exercises 9-11 we outline an alternate approach to the materials of this section. 
9. Let Je denote the set of all piecewise continuous functions fon (— ©, ©), identified 


in the usual way, with the property that 


ἡ 4)" dx « ο. 


—o 


(Such functions are said to be ‘“‘square integrable” on (— οὐ, ©).) 
(a) If fand g belong to Ja, set 


fg = [ f(x)g(x) dx. 


Prove that this defines an inner product on 92, and that with the usual definitions of 
addition and scalar multiplication 92 is a Euclidean space. 
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(Ὁ) Prove that 52. contains all functions of the form e-*"/4p(x), where p is a 
polynomial. 


10. With J2 as above, define the Hermite functions h,,n = 0,1, 2,..., by the formula 


2 2 
5,0.) -- (-1)}" Ε on a or it 


(a) Prove that A,(x) = e-27! *H,,(x), where H,, is the nth Hermite polynomial. 


(b) Prove that h,,°h, = Oifm Σέ n,andh, +h, = n'\/2n with respect to the inner 
product in J2. (The sequence {h,},n = 0,1,2,..., οἵ Hermite functions actually 
forms a basis for 92.) 


11. Show that the Hermite functions satisfy the same recurrence relation that the Her- 
mite polynomials do. 


12. Show that the functions 4,(x) = e~*’/4H,(x) satisfy the linear differential equation 


is 1 x” 
PF Wego aide 


13. Let {e-*"/4p,(x)} and {e-7"4g,(x)},n = 0,1,2,..., be orthogonal sequences in $2 
(see Exercise 9), and suppose that p, and g, are polynomials of degree n. Prove that 
for each n, py is a scalar multiple of gn. 


14, Prove that 


22 da’ εἰδὴ) 
ον | eH) , n=0,1,2,..., 
(—1) πί }}. 


α a nonzero real number, is an orthogonal sequence in 92 (see Exercise 9). (Actually, 
this sequence is a basis for 92.) 
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The last of the various sets of orthogonal polynomials which we shall formally 
discuss—the so-called Laguerre polynomials—arises in the study of functions on 
the semi-infinite interval [0, 00). In this setting we use the weight function e—*, 
and let J5[0, 0) denote the set of all piecewise continuous functions f on [0, 0) 
with the property that 


i e—* f(x) dx 
0 


converges. It is then easy to show that 99 is a Euclidean space under the usual 
addition, scalar multiplication, and inner product, the last being defined by the 
formula 


7}: 8 - in ee” f(x)g(x) dx. 


Moreover, since 


[ e*x"dx = n!, n= 0,1,2,..., (11-34) 
0 
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(Exercise 1), 35 contains all polynomials, and hence, as before, we have the fol- 
lowing theorem. 


Theorem 11-19. 9% is the set of all piecewise continuous functions on 
[0, 0) which can be expressed as limits in the mean of sequences 
of polynomials. 


From this it follows that any mutually orthogonal set of polynomials in 99, 
one of each degree, will be a basis for this space. One such set is the sequence 
{L(x}, n = 0,1,2,..., of Laguerre = where 


L,(x) = (—1)"e* —— 7 (ate ὅδ Ὁ (11-35) 


Indeed, when the argument used to establish Theorem 11-16 is adapted to this 
situation, we find that 
Lin ‘ Ln = 0, m = n, 


Ly Ln = (n!)?. {6 1590) 


Furthermore, we have 


Lemma 11-7. For each positive integer n, L,, is a polynomial of degree ἢ 
with 1 as its leading coefficient and —n? as the coefficient of x"~'. 


Proof. By repeated differentiation we find that 
aa = (xe) = χ᾽ = Pp de (11-37) 
(see Exercise 9, Section 11-3) where the terms omitted are of degree <n — 1 inx. 


The lemma now follows by substituting this expression in (11-35). ἢ 


To derive the recurrence relation for the Laguerre polynomials we reason as 
follows. The polynomial xL,(x) is of degree n + 1, and hence can be written 
in the form 


n+l 
xLn(X) = >> aela(), (11-38) 
k=0 
where 
a, -- Che, 
ὃ 1 4}}3 


But, by Lemma 11-1, (xL,)+ Ly, = Oforallk < n — 1. Hence (11-38) reduces to 
ΧΙ = Qn—1bn—1 ἘΝ Anbn + An+4 ibn+1- (11-39) 


We now equate the coefficients of x"** on both sides of this equation to deduce 


11-7 LAGUERRE POLYNOMIALS 445 


that a,4, = 1. In other words, 


(xLn) : En41 


Ln ; Τα 
and we have 
(xLn)*Ln41 = [+ 1)!]? 
see (11-36). Hence 
(xL») ᾿ Ly (xLn_1) 5 Ly 


“1 Ta—- ΠΣ [ὦ -- DP 


ni 2 
τ: Ε = " ae 


and (11-39) can be rewritten 
xL, = n*Ln—1 + anln + Lanai 


Finally, to find a, we equate the coefficients of x” on both sides of this expression 
and use Lemma 11-7. This gives a, = 2n + 1, and we have proved 


Theorem 11-20. The Laguerre polynomials satisfy the recurrence relation 


Engi + Qn + 1 — x)Ln + n?Ly_1 = 0 (11-40) 
for alln > 1, and all x. 


(Again this relation is valid when n = Ο if we set L_, = 0.) 


Starting with the value Lo(x) = 1 derived from (11-35), the above formula 
yields 
Lox) = |, 
L,(x) Ξ χΧ- I, 
L2(x) = x* — 4x 4+ 2, 
L3(x) = χῇ — 9x? + 18x — 6, 
L4(x) = x* — 16x? + 72x? — 96x + 24, 
L5(x) = x° — 25x* + 200x? — 600x? + 600x — 120. 


To complete our discussion it remains to derive the differential equation for L,. 
Here we start by differentiating (11-35) to obtain 


d ar laa 
Ente) = (— 1"? Saas (Xe) Ὁ La) 


nr 


= (—1"'e* © (nx"~"e~* — χε Ὁ) + Ln(x) 


n . α΄ n—1l —x 
= (—1) ne xn ἃ le ). 
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Sunilarly, 4" 
Gy [απο = (= 1)" ἢ τα Οὐ 65) + Ln-1); 
and we therefore have 
Li, = n£y_1 — πὰ, n 2 1. (11-41) 
But, by (11-40), 
{4.1 + Qn +1 -- LL — Ln + nLh_1 = 0, 
and since (11-41) implies that 
Thay = (®t DL, -- t+ Li and nL, = ΗἾ,,..1 — nL, 


we find that 
ΧΙ! = nL, + n?Ly_1. (11-42) 


We now use (11-41) again to deduce that n?L,_, + nL, = n*L,—1 and hence, 
by (11-42), that 
n°Li_» + nll, = xl, — ny. (11-43) 


Finally, differentiating (11-42), we obtain 


ΧΙ + 11, = nl, + ΗΠ... 


or, by (11-43), 
ΧΙ ΞΕ Ξε Το Ξε δῆς 


thereby proving 


Theorem 11-21. Zhe Laguerre polynomial of degree n is a solution of the 
second-order linear differential equation 


xy’ + d — x)y’ + ny = 0. (11-44) 


Equation (11-44) is known as Laguerre’s equation of order n, and, as we shall see 
(Exercise 11, Section 15-3), L, is the only polynomial solution of this equation with 
leading coefficient 1. 


EXERCISES 


1. Prove that 5" 
[ εχ χ = n', n=0,1,2,.... 
0 


2. Verify the formulas for L2, L3, and 1.4 given above. 


3. Prove that 950, ©) is a Euclidean space. 


11-8 | GENERATING FUNCTIONS 447 


4. Prove that 
0 ifm ~ ἡ, 


Ln La = a 
a ifm =n. 


5. Use the differential equation for the L, to prove the orthogonality of these polyno- 
mials in 4110, ©). [Hint: Mimic the argument used in the case of the Legendre 
polynomials. ] 


In the following exercises we give the student the opportunity to explore for himself an 
interesting variation of the material in this section. 
6. Leta > —1 bea real number, and let 


7 


a 6. foe G nr a—zr 
LO (x) = (—1)"x “ὁ πα οὐ ), 


n = 0,1,2,....Show that L& is a polynomial in x of degree n with leading coeffi- 
cient 1 for all a and all n. 
7. Prove that ᾿ 
[ xe ΟΝ (x) dx = 0 
0 . 


form + n, and hence deduce that {200 (x)},n = 0,1,2,..., 15 ἃ mutually orthogo- 
nal sequence of polynomials in the space 93 [0, ©) with weight function x%e~*. 


8. Prove that 
Z|? = nt T@ +a Ὁ 1), 
where Γ(α) denotes the gamma function. (See Exercises 25 and 26, Section 5-7.) 


9. (a) Prove that the Laguerre polynomials {L{*} satisfy the recurrence relation 
LO, + Qn tati— χε + nin + αὐ, = 0. 


(b) Compute the first four Laguerre polynomials L‘?). 


*10. Prove that Li” is a solution of the differential equation 


xy" + (@+1— xy’ +ny = 0. 


*11-8 GENERATING FUNCTIONS 


We have seen that each of the various types of orthogonal polynomials encountered 
in this chapter can be characterized in several different ways; by means of a 
Rodrigues formula valid for all n, by a recurrence relation, or as polynomial solu- 
tions of certain linear differential equations. Each of these definitions has some- 
thing to recommend it, and the particular one chosen is as much a matter of taste 
as anything else. In this section we shall introduce still another way of obtaining 
thes¢ polynomials—namely, by means of their so-called generating functions. 
Here the motivating idea is that the polynomials in question can be made to 
appear as the coefficients in the power series expansions of certain functions of 
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two variables, and in this sense are ‘‘generated”’ by these functions. Although 
this method may appear highly artificial at first—particularly since we make 
scant effort to motivate the choice of generating function—it is not so at all. In 
fact, in many physical problems the orthogonal functions we have been considering 
arise out of their generating functions in a perfectly natural way, and for this 
reason alone the following discussion has much to recommend it. 


I, The Legendre polynomials. Here we start with the function 


I 
G(x, r) = ( — 2xr + γ2}12 2 (1 1-45) 


which we expand as a power series in r under the assumption that x and r are chosen 
so that the resulting series converges. This allows us to write 


G(x, r) = Po(x) + Py(x)r + Po(xyr? 4+ +: 
> Pra(x)r"; (11-46) 
=0 


where Po, P,... are functions of x alone. These coefficients can be computed 
directly from (11-45) and (11-46) in the usual fashion, and it is not difficult to show 
that P,, must be a polynomial in x of degree n. For instance, setting r = 0 in 
(11--46) and noting that G(x, 0) = 1, we find that 


P(x) ae 


For our present purposes, however, it is sufficient to observe that this series is 
uni*ormly and absolutely convergent whenever |2xr — r?| < 1, and hence, under 
these conditions, can be differentiated term-by-term with respect to r to yield 


dG — = n—l1 ΝΕ 
aes pa nP,,(x)r"—t. (11-47) 
Bui, by (11-45), 
Os τον ei ee ς 
drs (A —- 2xr ΞΕ 75} 


or 
(1 — 2xr + py +(r— x)G = 0. 


Substituting (11-46) and (11-47) into this expression yields 


(1 — 2xr + r’) 3 nP,,(x)r"—' + (r — x) > P,(x)r” = 0, 


n=1 n=O 
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and it follows that 


οΌ 


> nP,(x)r"—'! — xPo(x) — > (2n + 1)xP,(x)r” 


n=! n=1 
+ Po(x)r + Σὲ (a + 1)Pa(x)r**? = 0, 
n=l 

or 
—xPo(x) + Po(xir + Σ᾽ (a + W)PngiGer” — SS Qa + 1)xPrQx)r” 

n=0 n=l 

1" 3 nNPy—\(x)r" = Ὁ, 
n=2 

Thus 


[Pi(x) = xP o(x)] -+- [2Ρ.(χ) = 3xP (x) Ἔ Po(x)Ir 


ot 3 [ἱ + 1)Pa4iQ) — Qn + 1)xPp(x) + nPy_i(x)}r” = 0, 


n=2 
and we have 
P, — xP») = 0, 
(n + ΠΡ... — Qn + 1)xP, + nP,_1 = 0, n> 1. 


But the second of these expressions is none other than the recurrence relation for 
the Legendre polynomials, and since Po(x) = 1 and P;(x) = x, we conclude 
that the coefficients in (11-46) are, in fact, the Legendre polynomials. Thus the 
function 


] 
Oe Ξ ΓΞ ΠΣ 
is a generating function for the Legendre polynomials. 

In physics, the function G(x, r) is encountered in the study of planetary motion 
and electrostatic potential, among other places. In fact, Legendre’s original 
memoir on this subject, published in 1785, 
was devoted to the study of the gravitational 
attraction of “spheroids,” and it is only 
fitting that we conclude our discussion of the 
Legendre polynomials with a brief indication 
of how this comes to pass. For various 
reasons we shall consider the case involving 
electrostatic potential, which, theoretically, is 
the same as the one treated by Legendre. FIGURE 11-4 
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Specifically, we pose the problem of determining the potential at an arbitrary point 
Q of the plane arising from a pair of point charges of magnitudes +o and —o 
located as shown in Fig. 11-4. Since the potential at Q due to a single point 
charge σ located R units away is o/R, the potential at Q in this case is 


1 ] 
y= σᾷ! - x): 


But, referring to Fig. 11-4 we see that 


R*? = r2 + x* — 2rxcos 8, 
R’? = r2 + x? — 2rxcos (πα — 86), 


frorn which it follows that 


1 1 x x?\ ΓΤ 

R > i ᾿ (2% cos # 7 3] 
Ϊ 1 x x2\ [112 
b= 11 — (22 cose - ὁ - ἢ : 


Save for notation, each of these expressions is the generating function for the 
Legendre polynomials, and we therefore have 


—— so" Ρ, (ρος 0) (% 3] 


and 


and 
= a= 5? P,,(cos (+ — 6)) (2 x)" = ae P,(—cos 6) (2) ; 
provided that |2(x/r) cos 9 — (x/r)?| < 1. Thus 
V = 4)? [P,,(cos 0) — P,x(—cos on aN 
n=O 


Finally, recalling that P,, is even if n is even, and odd if n is odd, the above ex- 


pression reduces to 
2σ 00 x 2n+1 
τ > Pon+1(COSs 6) 2 
n=0 


In elementary applications it is customary to approximate V by the first term 
in this series, in which case we have 


Vz S; (2x) cos 9 = <, d cos 8, 


where d is the distance between the charges. 
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II. The Hermite polynomials. Here a generating function is 


2 
G(x, r) = εὔῦ τ 12 (11-48) 


Indeed, since the series 
2 
=l+tz24+5+°°: 


is uniformly and absolutely convergent for all z, 


| 
— 
+. 
κ.«-- 
ξ 
| 
Ὁ 
NK SJ 
a 
NI] 
πὴ -: 
ὃς 
Ἂ 
to ™“ 
Ne or” 
iw] 
+. 


G(x, r) 


ee 


A(x) + Ay(x)r + ay Hal)? + 
for all x and all 7. Differentiating this series term-by-term we find that 


0G = > Fy 4.1(x) r”. 


But (11-48) implies that 


and hence that 


zi xH (x) a > xH,,(x) ΝΞ r”. 
n=l ὃ 
Thus 


Hy (x) ἘΞ Σ Hat) r” ΞΞ xHo(x) al y 


n=1 


xH,(x) = nH, _3(x) yr 
n! : 


and it follows that 
A, -- xf = 0, 
An41 — xH, + ΜΗ, = 0, n> 0, 
as required. 


Il. The Laguerre polynomials. In this case a generating function is 


G(x, 7) = pe PH, (11-49) 


SF 


an assertion which is proved as follows. 
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The Taylor series expansion of G in powers of r can be written in the form 
oo τ r” 
G(x, r) = pe (—1)"Ln(x) τ" (11-50) 


where L,(x) is a function of x alone. Moreover, this series converges uniformly 
and absolutely for all x and all r with |r| < 1 since G(x, r) is the product of two 
functions whose series are thus convergent. Hence 


n—1 


dG = ἢ r 


Moreover, by (11-49), 
a — rye Se ene enc 


and we therefore have 


n = n Ἐς 
(tL — ry p> (LN) Gy ΠῚ +(x—1+4 ἜΣ ἢ ΓΟ) τ = 0 
7 (11-51) 
An easy computation now reveals that 
Ingi + Qn +1 -- DLn + n?Lyz-1 = 0, n> 1, 


and since Lo(x) = 1 and L,(x) = x — 1, we are done. 


EXERCISES 
1. Let 
Big eee 
= Ga ter + nye 
Prove that 


(a) ({ — 2xr+ 2) — rG=0; 


b) ὦ - NS τ τ an 


(c) ra —_ = (7G) -( - γα) Ὃς = 


2. (a) Substitute the series 


G(x,r) = P,(x)r" 


n=O 
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into the identities in 1(b) and 1(c), and deduce in turn that 


nP,,(x) — xP7(x) + Pr-i(xs) = 0, n> 1, 
and | 
(n + 1)Pa(x) — Pryi(x) + χρᾷ) = 0. 


(b) Use these results to prove that 


Phiy — Phy = Qn + Ph 
for alln > 1. 


. Use the identities in the preceding exercise to derive the differential equation for P,. 
[Hint: Replace n by n — 1 in the second identity in 2(a) and then substitute the value 
of P),_; found in 2(b). Differentiate, and again eliminate P/,_,.] 


. Starting with the series 


prove that 
2 ἐς 2 
H,(x) = (-1)"e” ”” oe Bo, 
dx” 
[ Hint: err—r?/2 a er" /2e—(a—1)?/2 1 
. (a) With G as in Exercise 4, compute 0G/dr, and show that H7(x) = nH,_1(x). 


(Ὁ) Use the result in (a) and the recurrence formula for the H,, to obtain the dif- 
ferential equation for H,,. 


6. Show that the recurrence relation for the Laguerre polynomials follows from (11-51). 


7. Let the Laguerre polynomials be defined by their generating function 


I —rz/(l—r 
G(x, r) = ~>—~e i ᾿ 


(a) Prove that 
(1 — ἡ) ne + rG= 0, 
Ox 
and 


0G 0G 
i TO ee 3, = 2. 


(b) Use these identities and the series expansion 


Goa = 2) (WE) τ 


to prove that L, is a solution of the differential equation 


xy’ + (1 — x)y’ + ny = 0. 
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8. (a) Starting with the formula 


n xz εἶ Ὦ -τ-ὰ 
L,(x) = (--1) 6 AG (xe), 
show that 
L(x) = 5 (—1)* eal a 
4: (ι -- Κ)}} Κ' 


*(b) Use the result in (a) to sum the series 


00 5 γ᾽ 
ΣΣ (-1)"Lale) το 
ἘΞ n! 
and show that 
ἘΠ ae » (—1)"L,(x) a 


1—r aa 


[Hint: Interchange the order of summation.] 


*9, Prove that the function 


1 —rzx/(1—r) 
G(r, x) ΞΞ qd — ne [4 


is a generating function for the Laguerre polynomials L®., (See Exercises 6 through 
10 of the preceding section.) 


A Table of Orthogonal Functions 


The following table summarizes the results obtained in this chapter. For con- 
venience of reference we have also included the corresponding information for 
Bessel functions (see Chapter 15). 


LEGENDRE POLYNOMIALS 


Definition P,(x) = ilo @ (x? — 1)” 
2°n! dx” 
*Fecurrence P_,= 0, Po =1 


relation (n + 1)Ρ,.4.1 — (Qn + 1)ΧΡ, + nPr-1=90, n 20 


Lifferential 


ες τὰ 2... ὁ , = 
equation? ye on or ee eC ee 
Generating 1 
function ( — 2rx + r2)}/2 


Orthogonal in @C[—1, 1] 


Ort hogonality P..P 0, myn 


n+l. ee 


* The index —1 is used as a subscript on/y when working with recurrence relations. 
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HERMITE POLYNOMIALS 


Definition H,(x) = (—1"e" τ᾿ or? 
xr 


*Recurrence H_; = 0, Ho = 1 
relation Hna1 — ΧΗ, + nH,-1=0, n> 0 


Differential ' , =, 
equation salon iar LS ae 
_ Generating shade 
᾿ errr 
function 
Orthogonal in 92(— ©, ©); weight function en 2/2 
Orthogonality H.-H. = ° γι τέ κ 
V2rn!, m=n 
LAGUERRE POLYNOMIALS L, 
Defi iti _ n 2x d” n —2z 
efinition Ln(x) = (—1)"e” — αὐ) 
dx” 
*Recurrence L_; = 0, Ilo = 1 


relation | Lyi + Qn +1 — Ln + πῆμα Ξε, n> 0 


Differential 1 : 

equation xy’ + — x)’ + ny = 0 
Generating 1 —rz/(1—r) 

function l—r Ἢ 


Orthogonal in J3[0, ©); weight function e~* 
Orthogonality a - " mA 
(n!)”, m=n 


* The index —1 is used as a subscript on/y when working with recurrence relations. 
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LAGUERRE POLYNOMIALS Li 


Definition L® (x) = (—1)"x “εἶ ΕΝ αὐτο Ὁ), a>-—l 


*Fiecurrence L™, = 0, LO =1 
relation LO, + Qn tati — XL? + nn+ ADL@,=0, n>0 


Differential 


equation xy’ + @+1— x)’ + ny = 0 
~~ Generating 1 ee 
function ( — γ»).Ὲ1 
Orthogonal in 93[0, ©); weight function χορ Ὁ 
Orthogonality τς ὼς Ρ γι τέ π 
nT(int+at1), m=n 


BESSEL FUNCTIONS 


Definition Defined by the differential equation 


Recurrence 
relation XJn41 — 2pJp + χϑῦρ 1 = 0, pan arbitrary real number 
Lifferential 
2.,)} ae = 
equation x“yl! + xy! + ἃ p*)y = 0 


Crenerating 


Peas e(2/2)(t—1/t) 
unction 


Orthogonality Too lengthy to be summarized here. See Section 15-9. 


* The index —1 is used as a subscript only when working with recurrence relations. 
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boundary-value problems for 


ordinary differential equations 


12-1 DEFINITIONS AND EXAMPLES 


By far the most important application of the ideas we have been considering in 
the past few chapters occurs in the study of boundary-value problems for second- 
order linear differential equations. Formally, such a problem consists of 

(i) an equation of the type 


in which L is a second-order linear differential operator defined on a (finite) 


interval [a, δ], and ἢ a function in 6[α, δ]; and 
(ii) a pair of boundary or endpoint conditions of the form 


ayy(a) + agy(b) + agy’(a) + α4» (δ) = 11, 
Biy(a) + Boy(b) + Bsy'(a)  β4γ΄ (δ) = Yo, 
where the a;, 8;, and Y; are constants. The problem, of course, is to find all func- 


tions y in 6 ἴα, δ] which simultaneously satisfy (12-1) and (12-2).* 
For instance, the equation 


(12-2) 


γεν το (12-3) 

with boundary conditions 
y0)= 90, γα) = 0 (12-4) 
is a problem of this type on the interval [0, 7]. To solve it we simply apply the 


boundary conditions to the general solution c, sin x + c,.cosx of (12-3) to 


* Boundary conditions of a different sort must be imposed if the interval is infinite. 
An example of such a problem will be found in Section 13-8. 
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deduce that cg = O and that c, is arbitrary. Thus 
y = csin x, 


c an arbitrary constant, is the general solution of this particular problem. 

A\s we shall see, boundary-value problems abound in physics and applied mathe- 
matics, and the solution of all but the simplest of them involves some type of 
orthogonal series. Indeed, the need to solve boundary-value problems was the 
stimulus which originally led to the invention of orthogonal series, and as we 
proceed it will become apparent that their study is a mathematical discipline in 
its own right; not, as one might expect, an adjunct to the general theory of dif- 
ferential equations. 

In order to exclude certain trivial cases from the following discussion, we 
demand that at least one of the a; and one of the 8; appearing in (12-2) be dif- 
ferent from zero, and that the left-hand sides of these equations be linearly inde- 
pendent in the sense that they are not constant multiples of one another. Further- 
more, to ensure that we are actually looking at a boundary-value problem, and not 
an initial-value problem, we also require that (12-2) contain nonzero terms in- 
volving each of the endpoints of the interval. Finally, we shall say that the given 
boundary conditions are homogeneous whenever Ύ1 = Y2 = 0. In this case the 
set of twice continuously differentiable functions on [a, b] which satisfy (12-2) 
is a subspace 8 of 6 ἴα, δ], and by viewing L as a linear transformation from ὃ to 
C[a, b] the problem in question becomes one of solving a certain operator equation; 
to wit, the equation Ly = h, where h is a known function in @[a, b], and 
1:8 — C[a, Ὁ]. Despite its simplicity this observation is important because it shows 
that the boundary conditions influence the problem only to the extent of deter- 
mining the domain space for L. Strictly speaking, some symbol other than “Σ᾽ 
ought to be used to represent the operator from ὃ to C[a, δ], since heretofore we 
have considered L as acting on all of 6 ἴα, δ]. (Recall that operators with dif- 
ferent domains are different, even though the operators themselves are defined 
by the same formula.) However, such changes in notation would be as confusing 
as they are correct, and will therefore be avoided. But by the same token, it then 
becomes mandatory to specify the domain of the operator being considered when- 
ever there is any possibility of confusion. 

At this point we invoke a familiar argument to reduce the study of boundary- 
value problems with nonhomogeneous boundary conditions to the homogeneous 
case (see Section 2-9 and Exercise 8 below). Hence, unless otherwise stated, we 
shall assume from now on that all boundary conditions imposed are homogeneous. 

The solutions of a boundary-value problem involving a linear differential 
operator L: 8 — 6[α, δ] are intimately related to the solutions of the equation 


Ly = dy, (12-5) 


where \ is an unknown parameter. In this setting we are required to find all values 
of ) for which (12-5) admits nontrivial solutions in $, and then find the solutions 
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corresponding to these Δ. The reader should note that (12-5) may be rewritten 
(L — λὴν = 0, (12-6) 


where J denotes the identity transformation which sends each function in C[a, δ] 
onto itself, or as 


αφ(χ)ν" + ay(x)y’ + [ao(x) — Aly = 0 


if L = ao(x)D? + a,(x)D + ao(x). Thus, for each value of λ, (12-5) is a homo- 
geneous second-order linear differential equation, and the solution set of any 
(homogeneous) boundary-value problem involving this equation is the null space, 
in 8, of the operator L — NJ. 

This having been said, we observe that the above problem can be rephrased in 
the language of linear algebra without specific reference to the nature of the 
operator L, as follows: 


Given a linear transformation L: ὃ — VU, where 8 is a subspace of 0, find 
all values of d for which the equation 


has nontrivial solutions; then find all solutions corresponding to these values 


of X. 


And this is the problem with which we shall begin our investigations. But first, 
an example. : 


EXAMPLE. Solve the boundary-value problem 


γ + dy = 9, 
y0) = 0, = v(m) = 0. 


Here § is the space of all twice continuously differentiable functions on [0, 7] 
which vanish at the endpoints of the interval, and LZ is the second-order linear 
differential operator —D*. (The minus sign has been introduced merely to sim- 
plify the final results. Without it the relevant values of \ would be negative.) 
We distinguish three cases, according as \ = 0,’ < 0,A > 0.* 


(12-7) 


Case 1: \} = 0. Here the differential equation has c, + c2x as its general solu- 
tion, and the boundary conditions imply that cy = co = 0. Thus (12-7) has 
no nontrivial solutions when ἃ = 0. 


Case 2: < 0. In this case y = cye¥—** + coe V~*, and the boundary con- 
ditions again yield y = 0. 


* At this point we are tacitly assuming that ἃ must be real. This assumption will be 
justified later. 
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Case 3: > 0. Here the general solution of γ΄ + Ay = Ois 

y = c,sinW/rAx + cocos Vr x, (12-8) 
and the boundary conditions now yield the pair of equations 

Co= Ὁ, cysinVrAz = 0. 

Thus (12-7) admits nontrivial solutions if and only if 

sinvy/A r = 0; 


that is, if and only if \ assumes one of the values \,, = n*,n = 1,2,.... Further- 
more, for each of these values of ἃ the constant c; in (12-8) remains arbitrary, 
and it follows that the solution space corresponding to ἃ; is the one-dimensional 
subspace of C[0, 7] spanned by the function sin nx. 


The numbers \,, = 1” which determine the cases in which (12-7) has non- 


trivial solutions are called the eigenvalues for this problem, and each nontrivial 
solution corresponding to the eigenvalue 2, 15 called an eigenvector or eigen- 
function belonging to Δ. In the next section this terminology will be generalized 
to include a much wider class of problems, and for the moment we merely ask 
the) reader to note that any set of eigenfunctions, such as sin x, sin 2x, sin3x,..., 
one for each eigenvalue, is orthogonal in @[0, x]. This, as we shall see, is no accident, 
and when properly generalized will be of fundamental importance in the study of 
boundary-value problems. 


EXERCISES 
Find all solutions of each of the following boundary-value problems. 
1: γ΄ + y = 0; yO) = 1, γα) = - 
2, yy" + y = 0; yO) = 0, ν΄“) = 0 
3, y’’ + ἄν = sin 2x; γ(0) = 0, y@r) = 0 
4, γ' + Sy = e*; γ(0) = 0, γί) = 0 
5. »" + 9y = 0; γ΄) = 0, y'G@r) = 0 
6. y’’ + 9y = cos 2x; y’(0) = 0, y’(r) = 0 
7, γ΄" + 9y = x; y'(0) = 0, y'@r) = 0 
8, Let 


Ly = hy; 
By = 71, Bg = Ya, 
be a boundary-value problem of the type described by Eqs. (12-1) and (12-2) above. 


Prove that the solution set of this problem consists of all functions in C?[a, δ] of the 
form y, + yz, where y, is a fixed solution of the problem, and y, a solution of the 
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associated homogeneous problem 


B, = Bz = 0. 
9. Find all eigenvalues and eigenfunctions for the boundary-value problem 


» Ἔλν 0, 
yO) = γζπ), γ'(0) - γ΄). 


(Assume that ἃ is real.) 


10. Consider the boundary-value problem 


γ" + 4y’ + (4 + 9)y = 0, 
yO) = 9, γίῶ = 9, 
with ἃ real. 
(a) Show that this problem has no nontrivial solutions for \ < 0. [Hint: Consider 
the cases \ « OandA = 0 separately.] 
(Ὁ) Show that the only positive values of ἃ for which this problem has nontrivial 
solutions are 


and find the corresponding solutions. 


12-2 EIGENVALUES AND EIGENVECTORS 


In this section we consider the general problem of solving an operator equation of 
the form 
ΙΧ = Xx, (12-9) 


where L is a linear transformation from ὃ to U, 8 a subspace of 0, and λ an un- 
known parameter which can assume real or complex values. Technically, this 
problem is known as the eigenvalue problem for the operator L, and requires that 
we find all \ for which (12-9) has nontrivial solutions, and all solutions corre- 
sponding to these \. Our primary interest, of course, is in the case where ὃ and UV 
are Euclidean spaces, and LZ a second-order linear differential operator. Never- 
theless, we shall refrain from imposing these restrictions until Section 12-4 in 
order that our preliminary results be valid for general linear transformations and 
arbitrary vector spaces. 
As usual, we begin by introducing some terminology. 


Definition 12-1. The values of \ for which Eq. (12-9) has nonzero solu- 
tions are called the eigenvalues (or characteristic values) of L, and for each 
eigenvalue \ the nonzero vectors in 8 which satisfy the equation Lx = \ox 
are called the eigenvectors (or characteristic vecters) of L belonging to Xo. 
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The reader should observe that, by definition, the zero vector is never an eigen- 
vector for L. Furthermore, zero is an eigenvalue for L if and only if the equation 
Lx = 0 has nonzero solutions, 1.6., if and only if L is not one-to-one. Failure to 
appreciate these simple distinctions is a frequent source of confusion. 

If λο 15 an eigenvalue for L, and xo an eigenvector belonging to Xo, then 


L(axo) = aL(Xo) = a(\oX0) = AoleXo) 


for all real numbers a. Thus ax, is also an eigenvector belonging to \y) whenever 
a is|different from zero. This, combined with the obvious fact that the sum of two 
eigenvectors belonging to λρ is again an eigenvector belonging to Xg, yields 


Lemma 12-1. The solution set of the equation Lx = \ ox is a nontrivial 
subspace of 8 for each eigenvalue Χο of L. 


In other words, the zero vector together with the eigenvectors for L which belong 
to λο constitute a subspace of 8 (and hence, by implication, of Ὃ as well). We 
shall denote this subspace by ὅλ.» and observe in passing that dim 8), > 1 for 
all \». Geometrically, Z acts on 8), by “stretching” each of its vectors by the 
scalar factor λρ as indicated in Fig. 12-1. 


FIGURE 12-1 


We have just seen that ἔχο belongs to 8), for all xo in 8),. This fact is some- 
times expressed by saying that ὅλο is “invariant”? under L in accordance with the 
following definition. 


Definition 12-2. Let 1: 8 — Ὃ be a linear transformation, and suppose 
that 8 is a subspace of U. Then a subspace W of ὃ is said to be invariant 
under L if and only if Lw belongs to ‘W for all w in ‘W. 


We hasten to point out that there is nothing in this definition to imply that the 
nonzero vectors in an invariant subspace for L need be eigenvectors for L. Indeed, 
as we shall see momentarily, such a conclusion is false. Rather, the implication 
goes the other way: the 8, are invariant subspaces for L consisting of vectors 
with the special property that Lx = ox. 

Having introduced the notion of invariant subspace, we can now rephrase 
the definition of an eigenvector for a linear transformation L: ὃ — Ὃ to read as 
follows: A nonzero vector x in 8 is an eigenvector for L if and only if the one-di- 
mensional subspace of 8 spanned by x is invariant under L. This observation is 
frequently useful in the search for eigenvectors. 
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EXAMPLE 1. Let 61, 65 be the standard basis vectors in ®”, and let L: R? > @* 
be reflection across the e,-axis; that is, 


Te, = 6, Leg = -- 0. 


Then, from geometric considerations alone, it is clear that the only subspaces of 
@2 which are invariant under L are (i) the trivial subspace, (ii) ®? itself, and (iii) 
the two one-dimensional subspaces spanned by e; and 6.0. By the remark made a 
moment ago, the last two must be eigenspaces for L, and are the only such. Further, 
it is obvious from the definition of L that these subspaces are associated with the 
eigenvalues 1 and —1, respectively. 


EXAMPLE 2. If L: 63 — @? is reflection across the origin, then every subspace 
of ®? is invariant under L. In this case Lx = —-x for all x, and it follows that —1 
is the only eigenvalue for L, and that 8. 1 = G7. The reader should note that 
here the invariant subspace associated with the eigenvalue is two-dimensional. 


EXAMPLE 3. Let L be a rotation of ®” about the origin through an angle θ. 
Then, if θ is not an integral multiple of z, there are no one-dimensional invariant 
subspaces, and L has no eigenvectors at all. 


EXAMPLE 4. Let 8 be the subspace of @[0, x] consisting of all twice continuously 
differentiable functions y such that γ(0) = y(r) = 0, and let L: ὃ — Ο6[0, π] be 
the operator — D?. Then, by the example in the previous section, Z has an in- 
finite sequence of eigenvalues 


ΓΑ a: en co ως 


with associated eigenvectors c, sinnx, Cn ~ 0. 


All this is simple enough, but hardly explains why these notions were introduced 
in the first place. The following theorem furnishes a partial answer to this question, 
and gives an indication of the importance of eigenvectors in the study of linear 
transformations. 


Theorem 12-1. Any set of eigenvectors belonging to distinct eigenvalues 
for a linear transformation L: § — Ὃ is linearly independent in 8. 


(Note that this result would fail if 0 were allowed to be an eigenvector. Thus 
the prejudice against the zero vector found in Definition 12-1.) 


Proof. The theorem is obviously true when applied to a single eigenvector. Beyond 
this we reason by induction, as follows. 

Assume that the theorem has been proved for every set of n — 1 eigenvectors 
for L,n > 1, let x1,...,X, be m eigenvectors belonging, respectively, to distinct 
eigenvalues \j,..., An, and let 


αἸΧι oe ὁ" ἀρ. 1Χ5..1 ae = Ό. (12-10) 
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Then, applying L to both. sides of this equation, we have 


Or 


a Lx, + ett $+ an 1LXn_1 + anLXy, = 0, 


a (A1X1) ταν κᾶν ἃ On—1(An—1Xn—1) + Otn(AnXn) = 0. (12-1 1) 


now multiply (12-10) by Δ, and subtract the resulting equation from (12-11) 


to obtain 


But 


aiQa, τς An)X1 τσ αη--τί(λ,.-1 τ΄: An)Xn—1 = 0. 


; by assumption, the vectors x1,...,Xn— , are linearly independent. Hence 


each of the coefficients in this expression vanishes, and since ἃ; — A, ~ 0 when- 
ever i * n, we conclude that a; = Ofori = 1,...,n — 1. This, together with 
(12-10), implies that a, is also zero, and we are done. J 


EXERCISES 


1. 


2. 


3. 


4. 


2: 


Every vector space U has at least two subspaces which are invariant under a linear 
transformation L: Ὃ — VU. What are they? 


Let L be a linear transformation on a finite dimensional vector space Ὃ (.e., 
1,: Ὃ — VD), and let 8; be invariant under L. 


(a) Prove that there exists a subspace S2 of Ὃ such that every vector x in U can be 
written in one and only one way as 


xX = Xi + X2 


with x1 in $1, x2 in 85. [Hint: Choose an appropriate basis for U.] 

(Ὁ) Is the subspace 8. found in (a) necessarily unique? Why? 

(c) Prove, by example, that it may be impossible to choose the subspace $2 in (a) 
$o that So is invariant under LZ. [Hint: Let U = @,, the space of polynomials of 
degree <_n, and let L be the differentiation operator.] 


Let 81 and Se be invariant under a linear transformation L: ὃ — VU, 8 a subspace of V. 
Prove that the subspace of ὃ spanned by 81 and 8g is also invariant under L. 


(a) Show that the null space of a linear transformation L:‘U — V is invariant under L. 


(b) Let L: U > Ὁ bea linear transformation with the property that L? = L (i.e., L is 
idempotent on UV). Prove that the image of L is an invariant subspace of Ὁ. 


Let 8 denote the subspace of C2{a, δ] determined by a pair of homogeneous boundary 
conditions 


a y(a) + ae2y’(a) = 0, 
Biy(b) + Bay’(6) = 0, 


and let L: 8 — C@[a, δ] be the second-order linear differential operator defined by 


Ly = (py’)’ + ay, 
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where p is a function in C![a, δ] with p(x) > 0 for all x in [a, δ], and q is an arbitrary 
function in @C[a, δ]. Let γι and ye be a basis for the null space of L, viewed as an 
operator from @2[a, δ] to C[a, b]. Prove that zero is an eigenvalue for L: ὃ — C[a, δ] 
if and only if the determinant 


ay y1(a) + αὐ») a ya) + a2 y2(a) 
Biyi(6) + Boyi(6) Bi ya(b) + Be2ye(b) 


vanishes. 


12-3. EIGENVECTORS IN FINITE DIMENSIONAL SPACES 


We have seen that eigenvectors belonging to distinct eigenvalues for a linear 
transformation are linearly independent. In the finite dimensional case this fact 
immediately yields 


Theorem 12-2. A linear transformation L mapping an n-dimensional vector 
space Ὃ into itself has at most n distinct eigenvalues. Moreover, when the 
number of distinct eigenvalues is equal to n, any complete set of eigenvectors, 
one for each eigenvalue, is a basis for 0, and the matrix of L with respect 
to such a basis is 


An 
with the eigenvalues on the main diagonal and zeros elsewhere.* 


Of course, such bases need not exist for a given L: U0 — Ὃ (see Examples 2 and 
3 above). When they do, however, a number of pleasant things happen. For one, 
we can then solve operator equations involving LZ; and rather efficiently too. The 
following example will illustrate the technique. 


EXAMPLE 1. Let L be a linear transformation mapping @? into itself, and suppose 
that L has distinct eigenvalues \1, \2, A3. Let 61, €2, 623 be eigenvectors belonging 
to these eigenvalues, and consider the equation 


Lx = y, (12-12) 
y known, x unknown. Then, since the vectors 61, 62, 653 are a basis for R?, we have 


X = X10, + X22 + Xe, 
Υ = Κγιθ; + yoeo + yes, 


* Such a matrix is said to be in diagonal form. 
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and (12-12) can be written 

L(xye1 + x22 + X3€3) = yie1 + Yolo + ses. 
Hence 

(xyA1)e1 + (Xara)eo + (X3A3)€3 = Yie1 + 7262 + Yses, 
and it follows that Ἔν Χο, X3 must be chosen so that 

XyA1 = γι, Xer2 = Yo, X3d3 = 73. 


In particular, we see that (12-12) has a unique solution 


whenever the }, are different from zero. If, on the other hand, one of the d,, say 
d,,/iS zero, (12-12) has no solutions at all unless y; = 0. In the latter case the 
equation x;\, = yj is satisfied for all values of x, and the solution set of (12-12) 
then consists of all vectors of the form 


with x, arbitrary. 
The generalization of these results to n-dimensional spaces is obvious, and has 


been left to the reader. 


The technique introduced in the above example is known as the eigenvalue 
method for solving an operator equation. Its success depends upon the existence 
of enough eigenvectors for L to span Ὅ, and upon our ability to find them. But 
both of these questions can be settled by computing the eigenvalues for L, and 
thus we now address ourselves to this problem. 

In Section 2-9 we saw that an equation of the form Lx = y involving a linear 
transformation mapping an n-dimensional vector space U into itself can be 
written in terms of a basis for U as a system of linear equations 


41X1 + ayoXg τ τ AinXn = V1, 
a21X1 + aeeXe + °°' + GenXn = Ya, 
On1X1 + An 2 ΧΩ + eter AnnXn = Vns 
where 
Q11 Q@12Q2 «++ Qin 
Qa 9292 ee Aon 


Qn1 AXn2 oo e Ann 
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is the matrix of L, and x1,..., Xn and y,,..., yn are the components of x and y, 
all with respect to the chosen basis. In particular, this is true of the equation 


which, as we have already observed, is equivalent to 
(L — ΠΧ = 0, 


where J is the identity transformation on U. Noting that L — Δ] can be repre- 
sented by the matrix 


Q11 λ 212 eee Qin 
Q91 a29 — ae Aon 
9 
An An? eee Ann —= λ 


we therefore conclude that the eigenvalues for L are simply the values of » for 
which the system of homogeneous equations 


(αι: — A)X1 + = 1 2X2 ep eres Se Qinxn =O 
An1X1 = An ΧΩ ΞΕ ΡῈ (Onn = \)Xn = 0 


has nontrivial solutions. But this will occur if and only if the determinant of the 
coefficients of (12-13) vanishes (see Appendix III), i.e., if and only if 


Q11 — λ 12 eee Qin 
A921 a2 — Re casa Aon = 0. (12-14) 
Ant An?2 eee Ann στ λ 


Thus the eigenvalues for L can be computed by solving (12-14) for λ, and since 
the left-hand side of this equation is an nth degree polynomial in Δ, this can even 
be done by the methods of elementary algebra (at least for small values of n). 
The polynomial appearing in (12-14) is known as the characteristic polynomial of 
the linear transformation Z, and the equation itself is called the characteristic 
equation of L. As its name suggests, the characteristic polynomial is independent 
of the particular basis used to compute it; a fact which is also proved in Ap- 
pendix III. 
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EXAMPLE 2. Find the eigenvalues and eigenvectors for the linear transformation 
L: R? — @?, given that the matrix of L with respect to the standard basis 61, e> is 


In this case the characteristic equation of L is 


Or 


and 
Χ = 


this 


Ι--λ 0 
2 Ι-- nd 


= 0, 


( "" λ)" = 0, 


it follows that ἃ = 1 is the only eigenvalue for L. Hence a nonzero vector 
X1€1 + X22 will be an eigenvector for L if and only if Zx = x. Rewriting 
equation in matrix form as 


ΙΝΟΝΙ 


we find that x; and x2 must satisfy the equations 


Thu 


X1 = X1; 
2X4 + Χο = Χο. 


5 x, must be zero, while x2 is arbitrary, and the eigenvectors for 1. are of the 


form X2@2, χὰ ~ 0. Finally, the eigenspace is the one-dimensional subspace of 
GR? spanned by eo. 
The reader is encouraged to interpret these results geometrically by viewing L 


asa 


“shear” of the xy-plane parallel to the y-axis. 


EXAMPLE 3. Find the eigenvalues and eigenvectors of the linear transformation 
L on &? whose matrix with respect to the standard basis 61, 60, 63 is 


Si 


0 0 J 
0 -1l 0 
2 2 ] 
nce the characteristic polynomial of L is 
-λ 0 | 
0 -d+~A 0 | =-QA— 2)2 - 1)", 


2 2 Ι--λ 
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the eigenvalues for L are ὰ = 2 and \ = —1. To find the associated eigen- 
vectors we set x = x1e, + X2€2 + Xg€3, and solve the equation 


EX = XK (12-15) 
when A = 2andA = —l. 
In the first case, (12-15) becomes 
0 0 1 X1 2X1 
0 --ἰ 0 Xj; = 2X9 9 
2 2 1} | x3 2X3 
and we have 
x3 = 2X1, 
—xX%2 = 2X25 


2X1 + 2X9 + ΧΕ = 2X3. 


Thus x2 = 0, 2x; = χα, and the relevant eigenvectors are x,e; + 2x ,€3, x; an 
arbitrary nonzero constant. Here the associated invariant subspace, 8.2, is the 
one-dimensional subspace of ®* spanned by 6: + 263. 

Finally, a similar computation reveals that the eigenvectors belonging to the 
eigenvalue —1 are of the form x,e, — x e3, xX; an arbitrary nonzero constant. 
In this case the associated invariant subspace is the one-dimensional subspace of 
618 spanned by the vector 6; — 63. 


EXAMPLE 4. In the preceding section we invoked a geometric argument to prove 
that any rotation of ®? through an angle 6 ~ nx has no (real) eigenvalues or 
eigenvectors. We now establish this fact algebraically, as follows. 

The matrix of a rotation L of ®? with respect to the standard basis is 


cos@#é —sin@ 
sin 0 COs 6 
where @ denotes the angle of rotation. Hence the characteristic equation of L is 


cos@é— A —sin 6 


sin 6 cos 6 — XA 
and we have 

λ — 2(cos oA + 1 = 0. 
Thus 
A = cos 6 + isin 8, 


and it follows that ἃ is real if and only if 6 = na. Moreover, when this is the case, 
\ assumes one of the values + 1, and has all of ®? as its invariant subspace. 
Otherwise, \ is complex, and L has no eigenvectors. 
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RCISES 


. Find all eigenvalues and eigenvectors for the linear transformations on ®? defined 


by the following matrices. 


(a) ; j (b) ᾿ 4 (c) ; { (d) ; ἡ 
0 2 00 11 11 


. Find all eigenvalues for the linear transformations on ®® defined by the following 


matrices, and in each case find the eigenvectors belonging to the real eigenvalues. 


(a) 2 0 1 (b) | 1 2 0 
—] 2 3 0 1 1 

1 0 2 0 1 1 

(c) = 1 0 (4) [2 0 0 
I 2 2 0...--ἴ 0 

0 --1 0 1 0 1 


.| Repeat Exercise 2 for the following matrices. 


(a) 1 0 1 (b) {1 0 1 
0 1 0 0 2 0 

1 0 1 1 0 - 

(c) 5 πό —6 (4) | 1 Z 1 
-1 4 2 1 2 1 

3 -6 —4 0 1 2 


_|Find the eigenvalues and eigenvectors for the linear transformations on @* defined 


by the matrices 


(a) 1 0. —1 0 (Ὁ) | —1 2 1 3 
0 1 1 0 0 0 --2 1 

=o 1 2 1 0 0 2 =3 

0 0 1 --ἰ 0 0 0 4 


. Let L: 6.8 --ἡ BR be the linear transformation whose matrix with respect to the 


standard basis 61, €2, 62 1S 
10 2 


0 1 O 
2 0 1 
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Use the eigenvalue method to solve the equation Lx = y for x, given that 
(a) y = 2e1 + 62; (b) y = e1 63; (c) y = 46; — 2e2 — 2e3. 


6. Repeat Exercise 5 when the matrix of L is 


0 2 1 
QO 1 3)> 
0 0 2 

and 

(a) y = —2e, + e2; 

(Ὁ) y = 4e1 + 4ee + 2e3; 


(c) y = δι + 962 + 2e3. 


7. Prove that every linear transformation on an odd-dimensional vector space has at 
least one real eigenvalue. Give a geometric interpretation of this result for linear 
transformations on 68. 


8. An (” X n)-matrix is said to be triangular if all of the entries above (or below) the 
main diagonal are zero. Prove that each of the diagonal entries in such a matrix is an 
eigenvalue for the linear transformation on 65 defined by the matrix. 


*9. (a) Let L be a linear transformation on a finite dimensional vector space U, and 
let \o be a real eigenvalue for ZL of multiplicity m, by which we mean that (A — do)” 
is a factor of the characteristic polynomial for L. Prove that the dimension of the 
invariant subspace associated with Xo is at most m. [Hint: Consider the character- 
istic polynomial of the linear transformation obtained by restricting Z to the sub- 
space $),.] 

(b) Give an example to show that this dimension can, in certain cases, be less than 
m. [{Hint: Consider the operator — D on the space of polynomials @,.] 
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In this section we begin the process of extending the eigenvalue method introduced 
above to include operator equations defined on infinite dimensional Euclidean 
spaces. Our objective is to isolate a class of linear operators whose eigenvectors 
can be used to construct bases, and which, at the same time, includes the operators 
arising in the study of boundary-value problems. Clearly, the first step in such a 
program is to select a criterion which will guarantee that eigenvectors belonging 
to distinct eigenvalues are orthogonal, and to this end we now introduce the notion 
of a symmetric linear transformation, as follows. 


Definition 12-3. Let ZL be a linear transformation from 8 to VU, where 8 
and U are Euclidean spaces, ὃ a subspace of U0. Then L is said to be sym- 
metric with respect to the inner product on V if and only if 


(Lx)-y = x: (Ly) (12-16) 
for all x and y in 8. 
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Before giving any examples, we prove that this definition accomplishes our ob- 
jective by establishing 


Theorem 12-3. Every pair of eigenvectors belonging to distinct eigenvalues 
for a symmetric linear transformation L: ὃ — Ὃ are orthogonal in Ὅ. 


Proof. Let x; and xg be nonzero vectors in ὃ, and suppose that Lx; = 4X4, 

[Χο ΞΞ λοΧο, with λι aad do. Then 
(Lx1) + Xe 
x1  ([Χ2) 


i(X1 " Xa), 
λοί(χ! " Xa), 


and since (Lx;)* Xz = Χι' (Lxg), it follows that 
(Ay — A2)(K1+X2) = 0. 
But, by assumption, \; — λα ¥ O. Hence x,+ xX» = 0, as asserted. J 


EXAMPLE 1. Let ZL be a symmetric linear transformation mapping a finite di- 
mensional Euclidean space Ὃ into itself, and let e;,...,¢e, be an orthonormal 
basis in U. Then if 


Le; = 15701 +- aS + Anjens jJ= ΘΈΕ" 
we have 
6; " (Le;) = @;° (a 1;e1 2 ae Onjn) 
ayj(@;-€1) ἘΠ + αμίος es) τ + anj(@x " n) 


Οἱ}: 


Ι 


the last step following from the fact that 


On the other hand, 


(Le;) - 6) = (α:τιθ1 7 eS Aniln) "Ὁ; 
ay(€,°e;) + °°* + a;(e;-e;)) 7 + Ani(en * €;) 


—= Aji, 


Ι 


and the equality (Le;)-e; = 6; (Le;) implies that a;; = a;; for all i and all 7. 
Thus the matrix of L with respect to the basis e),...,@, 15 a symmetric matrix 
in the sense that its rows and columns may be interchanged without changing the 
matrix itself. 
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Conversely, suppose that the matrix of L is symmetric with respect to an ortho- 
normal basis e;,..., €, in VU, and let 


Le; = 41;€1 t+ ees + Anjens J = Loe 
Then 
(Le;) °C) = ay = αἱ) = θὲ" (Le;) 


for all i and j, and hence if x and y are arbitrary vectors in U with 


= χιθι +s + Xen, 


Vie 2 ihe we Vnl€ns 


ἊΣ Σ x;y;(Le;) » e; 


t=1 j=1 


> xiy;ei + (Le;) 


t=1 j=l 


= x- (Ly). 


Thus L is symmetric on U, and we have proved 


we have 


(Lx)-y 


Theorem 12-4. A linear transformation on a finite dimensional Euclidean 
space ‘0 is symmetric if and only if the matrix of the transformation with 
respect to any orthonormal basis in © is a symmetric matrix. 


EXAMPLE 2. Let L: R? — @? be defined by the matrix 


Ι 
0 
Ι 


oO »" © 


1 
0 
] 


with respect to the standard basis 61, €2, 62. Then, by the above theorem, L is a 
symmetric linear transformation, and an easy computation reveals that its charac- 
teristic equation is 


χὰ δ τ Ξ 
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Hence the eigenvalues for L are 0, 1, 2, and Theorems 12-2 and 12-3 imply that 
any complete set of eigenvectors for L will be an orthogonal basis for 6.5; a fact 
which can be readily verified by direct computation. Finally, we note that the 
matrix of 1, with respect to such a basis assumes the diagonal form 


oO Oo O&O 
So —_— © 
No So ὦ 


EXAMPLE 3. Let 8 denote the subspace of C[0, 7] consisting of all twice 
continuously differentiable functions y such that γ(0) = y(m) = 0, and let 
L: 8 > 6[0, x] be the operator —D*. Then, using integration by parts, we find 
that if γι and γ. belong to ὃ, 


(Lyi) γε = — [ " yil(x)ye(x) dx 


- -γιοῦ»»Οῦ af: [ " yh yh(x) dx 
and 
yi (Lya) = - “γι νυ) dx 


= —yile)y2(x)|" τ [γἱοῦνεο) dx. 
0 ο΄ 
But, by assumption, y,(0) = γ.(π) = 0, γω(0) = yom) = 0. Thus 
ἀν)» = [ " ya(x)yh(x) dx = γι" (Lye), 


and L is symmetric on 8. Here again Theorem 12-3 applies, and we can assert 
that any complete set of eigenvectors for L is an orthogonal set in C(O, 7]. This 
agrees with the results obtained in Section 12-1 where we found that the elgen- 
values for L are the integers \, = n,n = 1,2,..., and that the corresponding 
eigenvectors (or eigenfunctions as they are called in this case) are ἐμ SIN NX, Cy an 
arbitrary nonzero constant. 


The reader may have noticed that all of the eigenvalues for the linear trans- 
formations considered in the last two examples were real. This, as it turns out, is 
always true of symmetric linear transformations; a fact which we state formally as 


Theorem 12-5. All of the eigenvalues for a symmetric linear transformation 
are real. 


The proof of this result, though not difficult, would necessitate introducing com- 
plex inner product spaces, and is therefore omitted. The interested reader can 
find the argument in any standard text on linear algebra. 
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EXERCISES 


1. 


*6; 


Let L be the symmetric linear transformation on ®? defined by the matrix 


a b 
> el 
with respect to the standard basis. 
(a) Show that L has two distinct real eigenvalues except in the trivial case where 
b = Oanda =e. 
(b) Find a basis for R? composed of eigenvectors for Z in the nontrivial case. 


. Let ZL; and 1.9 be symmetric linear transformations mapping Ὃ into itself. Prove that 


the transformation L,L2 is symmetric if and only if 1,11,5 = LoL}. 


. Let ὃ denote the subspace of C[0, 2] consisting of all twice continuously differentiable 


functions y such that y’(0) = γ'(π) = 0, and let L: 8 — C[0, x] be the operator — D?. 
Prove that Z is a symmetric linear transformation, and find its eigenvalues. 


. Determine whether or not the following linear transformations are symmetric on the 


Euclidean space of polynomials with inner product p+ gq = [ _1 PX)q(x) dx. 
(a) Lp(x) = xp); (Ὁ) Lp(x) = p’(x); 


(©) Lp) = pe + 1) — po); (d) Lp(x) = 9 PO 


. Let δ᾽ denote the set of all real-valued functions of an integer variable k, 


—o <k < o, and let A?: ¥ — § be defined by 
(A2F)\(k) = F(k + 1) — 2F() + F(k — 1) 


for all F in § and all Κα. 

(a) Show that & is a real vector space under the usual definitions of addition and 
scalar multiplication, and that A? is a linear transformation on §. 

(b) Find the null space of A?. 


Let ὅ0 denote the space of all real-valued functions defined on the finite set of integers 
0,1,..., N,N + 1, and for each pair of functions F, G in Fo, set 


N+1 


F-G = Σ᾽) F(A)G(K). 


k=0 


(a) Prove that ¥o is a Euclidean space. 


(Ὁ) Let 51 be the subspace of So consisting of those functions F for which F(0) = 
F(N + 1) = 0, and let A? be defined as in Exercise 5 above. Prove that A? is a 
symmetric linear transformation on ¥;. [The symbols F(—1), F(N + 2), G(—1), and 
G(N + 2) will appear in the computations, but no matter what values they are given, 
the asserted result holds.] 

(c) Find the eigenvalues and eigenvectors for the operator A? on $1, and check by 
direct computation that the eigenvectors belonging to distinct eigenvalues are or- 
thogonal. 
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12-5 SELF-ADJOINT DIFFERENTIAL OPERATORS; 
STURM-LIOUVILLE PROBLEMS 


We have seen that the operator — D* becomes a symmetric linear transformation 
when restricted to the space of twice continuously differentiable functions on 
[0, x] which vanish at the endpoints of the interval. Such behavior is typical of a 
large number of differential operators, and when properly generalized furnishes 
the key to the study of boundary-value problems. To effect this generalization we 
now introduce the class of self-adjoint linear differential operators. 


Definition 12-4. A second-order linear differential operator L defined 
on an interval [a, b] is said to be in self-adjoint form if 


L = D(p(X)D) + 40), (12-17) 


where p is any function in C'[a, δ] such that p(x) > 0, or p(x) < 0, for 
all x in the open interval (a, b), and g is an arbitrary function in C[a, δ]. 


Despite its appearance, (12-17) is sufficiently general to include all normal 
second-order linear differential operators on [a,b]. For if L = ao(x)D? + 
a,;(x)D + ao(x) is such an operator, then LZ can be written in self-adjoint form 
by setting 

p(x) = o Siai (2)/a9(x) Idx 
and 


A(X) Stay (a)/ag(2)Idz 
x) = —~<e 
40) a2(x) 
(see Section 6-3 and Exercise 1 below). Thus, without any real loss of generality, 
we can (and shall) restrict ourselves to the study of self-adjoint operators, and to 


differential equations of the form 


4 (pe) 4) + φρὴν = h(x). (12-18) 


Finally, we note that the function p appearing as the leading coefficient in this 
equation is allowed to vanish at the endpoints of [a, b]. This fact will be of some 
importance later. 

Our immediate objective is to determine conditions under which a self-adjoint 
operator will be symmetric when viewed as a linear transformation from § to 
C[a, b], 8 a subspace of 6 ἴα, δ] determined by a pair of homogeneous boundary 
conditions 


ay(a) + aey(b) + αν΄ (α) + aay’(b) = 0, 
βιγ(α) + Boy(b) + Bsy'(@) + β4» (δ) = 0. 


To this end we first prove the following lemma. 


(12-19) 
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Lemma 12-2. (The Lagrange Identity.) If 


1, = D(p(x)D) + q(x) 


is any self-adjoint linear differential operator on [a, δ], and if y; and γὼ are 
twice differentiable on [a, b], then 


yi(Ly2) — (Lyi)ye = [pOive — yoyi)l’. (12-20) 


(As usual, the primes denote differentiation.) 
Proof. We simply apply the definition of L, and rearrange terms, as follows: 


yilLy2) — ([»1})»2 = yil(py2)’ + ave] — yel(pyi)’ + ani] 
yilpy2)’ — yo(pyi)’ 

yilpy? + p’y2] — γεργί + p’yi 
P'Diy2 — yoyi) + ply! — yoy] 
[pPO1y2 — yoy). 4 


Ι 


Formula (12-20) can be written in much more suggestive form by integrating 
from ato ὃ. For then its left-hand side becomes γι " (Ly2) — (Ly )* yo, and we 
therefore have 


b 
γι" (Ly) — γι). v2 = pOriys — yay), (12-21) 


from which we immediately deduce 


Theorem 12-6. Let ὃ be a subspace of ©7[a, b] determined by boundary 
conditions of the type given in (12-19), and let L be any self-adjoint linear 
differential operator mapping 8 into C[a, b]. Then L will be symmetric with 
respect to the standard inner product on ©[a, δ] if and only if 


ἦξ 0 (12-22) 


ΡΟΣ — y2¥1) 
for all y, and yo in 8; 1.e., if and only if 


P(6)L1(6)y26) — yo(b)yi(6)] — plabyi(a)y2(@) — yo(ayi(@)] = 0. 


Before giving any examples, we use Theorem 12-6 to determine several of the 
more obvious and important boundary conditions which lead to symmetric 
operators. 


Case 1. p(a) = p(b) = 0. Here (12-22) is satisfied without restriction, and we 
can set ὃ = ΘἼα, δ]. 


Case 2. Let ὃ be the set of all y in C[a, b] such that 


αι)(α) + αὐ» (α) = 0, 


12--3 
βι»(Ὁ) + βεν (Ὁ) = 0, Cre 


478 βουνραβυύ.ναιῦῊ PROBLEMS | CHAP. 12 


with [α1| + |a2| 4 0 and |6,| + |82| σέ 0. (These last conditions are imposed 
to force at least one of the a’s and one of the 6’s to be different from zero.) Then, 
if y; and y2 are any two functions in ὃ, 


yi(a)y2(a) — yo(a)yi(a) = 9 


yilb)y3(b) — γο(δ)νι(δ) = 0. 


Hence (12-22) vanishes on ὃ, as desired. 


and 


A boundary condition of the form 
aiy(a) + agy’(a) = 0 


which involves the values of y and y’ at only a single point is said to be unmixed. 
In these terms the above argument asserts that a self-adjoint linear differential 
operator is symmetric on every subspace of C7[a, b] described by a pair of unmixed 
boundary conditions. (Note that only one such condition need be given if p vanishes 
at a or at ὁ.) 


Case 3. Assume that p(a) = p(b), and let 8. be the subspace of Cla, δ] consist- 
ing of all y such that 
= y(b 
wa) " ) (12-24) 
y’(a) = γ' 0). 


Then (12-22) is obviously satisfied for all y; and y2 in 8, and Lis again symmetric. 
This is known as the case of periodic boundary conditions. 


EXAMPLE 1. Let 8 be the subspace of ©7[0, x] consisting of all functions y satisfy- 
ing the pair of unmixed boundary conditions | 


γ(0) = y(r) = 0, 


and let L = —D?. Then, by Case 2, L is symmetric on 8, 


EXAMPLE 2. By Case 3, the operator -- 25 is symmetric on the subspace of 
@7[0, 2x] described by the periodic boundary conditions 


y0) = Qn), iii 
yO) = y'@n). 


To find its eigenvalues and eigenfunctions we again apply the given boundary 
conditions to the general solution of 


y’ + ry = 0. (12-26) 


The argument proceeds by cases, as with the example in Section 12-1.* 


* Note that by Theorem 12-5 we need only consider real values of 2. 
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When \ «0, _ 
y= cyev + Coe ae 


and (12-25) implies that cy = c2z = 0. Hence there are no negative eigenvalues. 
When i = 0, the general solution of (12-26) is cy + οὐχ, and the boundary 
conditions can be satisfied by setting cg = Ο and leaving c, arbitrary. Thus 
= 0 is an eigenvalue, and its associated eigenfunctions are the constant func- 
tions on (0, 27]. 
Finally, when \ > 0, 


y = ce, sinV/rx + co cos Vx, 


and (12-25) leads to the pair of equations 


ci{1 — cos (2πν, )] = cz sin QrV/), 
Cofl — cos 2rV/d)] = —Ce sin (2rV/d), 


which can be satisfied with y ¥ 0 by setting \/\ = 1, 2, 3,.... Thus the integers 
ὦ 


are eigenvalues, and the invariant subspace associated with π2 is the two-dimen- 
sional subspace of C[0, 27] spanned by the functions sin nx and cos nx. 


Boundary-value problems involving self-adjoint linear differential operators 
with mutually orthogonal eigenfunctions are usually referred to as Sturm-Liowville 
problems after the mathematicians J. C. F. Sturm and J. Liouville who first in- 
vestigated them. Thus, each of the problems considered above was a Sturm- 
Liouville problem. More generally, a Sturm-Liouville problem, or system, is, by 
definition, a second-order homogeneous linear differential equation of the form 


4 (ne 2) + tg) -- Ny = 0 


p and q as above, together with a pair of (homogeneous) boundary conditions 
chosen in such a way that eigenfunctions belonging to distinct eigenvalues for the 
operator 


D(p(x)D) + a(x) 


are orthogonal.* In the next chapter we shall see that such systems arise naturally 
in the study of boundary-value problems involving partial differential equations, 
and for this reason are extremely important in physics and applied mathematics. 


* This terminology will be generalized in Section 12-8 to a somewhat wider class of 
problems. 
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EXERCISES 


1. Prove that every normal second-order linear differential operator a2(x)D? + 
ax(x)D + ao(x) can be put in self-adjoint form by setting 


[ay (x) /ag(x)]dx 
p(x) εἰς 5) a1(x)/ag(x 


ag(x) of (a1 (2) /ag(z)]dz 


q(x) = Paes 


2. Rewrite each of the following linear differential operators in self-adjoint form. 
(a) D+—-D+1, x > 0 
(Ὁ) (cos x)D? + (sinx)D — 1, --π 7,2} <x < 7/2 
(c) x?D2 + xD + (x? — p*), x > 0, pareal number 
(ὦ  — x2)D? — 2xD+ n(n - 1), —1 < x < 1, na non-negative integer 


3. Find all eigenvalues and eigenvectors for the Sturm-Liouville system 


γ᾽ + ry = 0,7 
γ(--π) = ὦ, γ΄) = 0. 


4. Repeat Exercise 3 for the Sturm-Liouville system 


y’ + r»y = 0, 
y0) = 0, ym) = 0. 


12-6 FURTHER EXAMPLES 


In this section we consider a number of Sturm-Liouville problems which will be 
encountered repeatedly in our later work, and which, for convenience of refer- 
ence, we solve here, once and for all. In each case we shall limit ourselves to 
finding eigenvalues and eigenfunctions, and postpone any discussion of how this 
information is used to solve specific boundary-value problems involving the given 
operator. 


EXAMPLE 1. Solve the Sturm-Liouville system 


γ᾽ + ry = 0, 
yO)=90 Ξ γὼ - 0. 


This is a variant of a problem we have already considered many times over, 
and this time we find that the constants 


nx? 


ia = Re? (a 1 2ιῖν ΣΝ 


12-6 FURTHER EXAMPLES 481 


and functions 
p(x) = sin => n= 1,2,..., 


are complete sets of eigenvalues and eigenfunctions. 


EXAMPLE 2. Solve the Sturm-Liouville system 


y’ + ry = 0, 
y0O=0 y= 0. 


A computation similar in all respects to the one used to solve Example 1 reveals 
that the eigenvalues for this problem are the non-negative constants 


and that 


is a complete set of eigenfunctions. The details are left to the reader. 
EXAMPLE 3. Solve the Sturm-Liouville system 
γ + ry = 0, 
y(O) = 9, 
hy(L) + y'(L) = 9, 


given that / and L are positive constants. (Note that the boundary conditions are 
unmixed, and that the problem falls under Case 2 above.) 

As usual, we argue by cases, depending upon the algebraic sign of \, and again 
find that there are no eigenvalues < 0. On the other hand, when A > 0, 


yH Cy sin V/X x + co cosVdX x, 


and the first boundary condition implies that cp = 0. Thus it remains (if possible) 
to choose ἃ so that the function 


y = c,sinVrAx, 


with c,; τέ 0, satisfies the equation Ay(L) + γ΄) = 0. This, in turn, implies 
that ἃ must be chosen so that 
VAL 


sin(/AL) = — cE 


cos (ν. 2); (12-27) 
an equation which we rewrite as 


tanu = — (12-28) 


AL © 
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FIGURE 12-2 


by setting μ = νι}. Although it is impossible to solve (12-27) explicitly for λ, 
its solutions can be visualized as arising, via (12-28), from the points of inter- 
section of the graphs of the functions tan and —y/AL. As indicated in Fig. 
12-2, there are infinitely many such points 


oe > b—25 M_1,HW0 = 0, μι: Μ2:...". 


located symmetrically across the origin. Thus the given problem has an infinite 
number of positive eigenvalues 
μϑ 
An = 72’ ae) Cee ες 
with An < An41 for all n, and lim,. An = οὐ. [Also note that from the geom- 
etry of the situation we have limy_,. (An41 — An) = π.] Finally, the functions 


in Hn 
n(x) sin Τ 


SIV Ay Xs = 1,2.,..., 
constitute a complete set of eigenfunctions for this problem. 


EXAMPLE 4.* Solve the Sturm-Liouville problem 


4 - 2) 2] + ry = 0 (12-29) 


on the interval [—1, 1]. 

The leading coefficient of this equation vanishes at the endpoints of the interval, 
and hence, by Case 1 above, the operator D[(1 — x”)D] is symmetric on all of 
e@?[—1, 1]. Moreover, since (12-29) is the self-adjoint form of Legendre’s equation 
(of order Δ), our earlier results imply that the integers n(n + 1),n = 0,1,2,..., 


* This example should be omitted by anyone who is not familiar with the material in 
Sections 11-2 through 11—4. 
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are eigenvalues, and that the Legendre polynomials 


Po(x), P(x), P(x), oe 


are eigenfunctions for the problem.* To complete the discussion it remains to 
show that these polynomials are a complete set of eigenfunctions for (12-29). Here 
we argue as follows. 

Were λὺ ¥ n(n + 1) an eigenvalue of (12-29), and yo an eigenfunction be- 
longing to \o, then yg would be orthogonal in C[—1, 1] to al/ of the P,. But, as 
we know, the Legendre polynomials are a basis for C[—1, 1], and hence, by 
Lemma 8-3, yo = 0. Since this cannot be, no such eigenvalue exists. 


EXERCISES 


1. Verify that the eigenvalues and eigenvectors listed in Example 2 above are correct. 


2. (a) Show that the boundary-value problem consisting of the fourth-order differential 
equation 


and boundary conditions 


γ(0) = γ() = 06, yO) = y') = ὁ 


has nontrivial solutions if and only if 


(b) Use the technique introduced in Example 3 above to prove that the boundary- 
value problem in (a) has infinitely many non-negative eigenvalues w,, 2 = 0, 1, 
2,.... How do these eigenvalues behave asn - οὐ 

(c) What is the general solution of the boundary-value problem in (a) correspond- 
ing to the eigenvalue ὦ, 


3. Let L denote the fourth-order linear differential operator D*, and let S denote the 
subspace of C4[a, δ] consisting of all functions y such that 


y(a) = y’"@ = y) = γ΄ "(δ) = 0. 
(a) Prove that 
yi(Ly2) — yo(Ly1) = Diy?’ — γονή" — yiy2 + yayt) 
for all y; and yo in S. 


(b) Use the result in (a) to prove that eigenfunctions belonging to distinct eigen- 
values for the boundary-value problem L: ὃ — @[a, δ] are orthogonal. 


* Note that at this point Theorem 12-6 allows us to assert, without further proof, that 
the Legendre polynomials are mutually orthogonal in ΦΟ [—1, 1]. 
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12-7 BOUNDARY-VALUE PROBLEMS AND SERIES EXPANSIONS 


We began this chapter by defining a boundary-value problem to be an operator 
equation of the form 
Ly=h (12-30) 


in which ἢ is a known function in @[a, δ], and L a second-order linear differential 
operator acting on a subspace 8 of Θ ἴα, δ] described by a pair of boundary con- 
ditions of the form (12-2). Since then we have said very little about such problems 
and have, instead, been off chasing eigenvalues and eigenfunctions. It is now time 
to justify this apparent digression by returning to our original problem and apply- 
ing what we have learned to solve it. 

The method we propose to use is a straightforward generalization to infinite 
dimensional Euclidean spaces of the eigenvalue method introduced in Section 12-3, 
and thus depends upon the existence of an eigenfunction basis for C[a, δ]. As yet, 
of course, we have no assurance that such a basis will exist, even when L is sym- 
metric, but if it does we can argue as follows. 

Let 

Neg χη λον 


be the eigenvalues for L, and let 


vo(x), φι(χ), Go(X),... 


be a complete set of eigenfunctions belonging to the \,. Then, since the ¢; are a 
basis for C[a, δ], we have 


nx) = >> cava, 
n=0 


where 
gh cg ΣῪ So h(x)en(x) dx 
" llenll? Jo [en(x)]2 dx 


and the series converges in the mean to h. We now set 
y@) = ΣΣ anvnlx), (12-31) 
n=0 
with the a, unknown, and substitute in (12-30) to obtain 
Σ oven] - > ener (2). 


Thus if Z can be applied to (12-31) term-by-term, we have 


οο 


Σ᾽ AnAnn(X) = > Cn On(X) 
n=0 


n=0 
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(recall that Lo, = Angn), and it follows that (12-31) will be a solution of the 
given equation whenever 
(i) the a, can be chosen so that 


Ann = Cn 


for all n, and 
(11) with these as the values of a», the series 


3 OnOn(X) 


n=0 


defines a function in @*[a, b] whose first two derivatives can be computed by 
termwise differentiation. 

It is clear that the first of these requirements can be met by setting an =Cp/ \n 
so long as \, ~ 0 for all 1 (i.e., so long as L is one-to-one). Furthermore, the 
resulting solution is then unique. If, on the other hand, one of the λ,,, say λρ, is 
zero, the problem has no solution at all when cy ~ 0, and an infinite number of 
solutions when cy = 0. 

Unfortunately, no such simple analysis can be used to dispose of (ii), since here 
we must investigate the convergence of the series 


>> Ἢ φ,(Χ). 


n=0 


As we have already seen, this is a delicate problem whose solution depends 
upon the properties of the function A from which the c, are derived, and upon the 
particular orthogonal system ¢, appearing in the series. Thus different orthogonal 
systems must be examined individually, and the best that can be said in general 
is that the desired termwise differentiability will be possible whenever ἢ is “‘suf- 
ficiently smooth.” (However, see Theorem 12-7 below.) In the absence of specific 
information as to what degree of smoothness is “sufficient” in any given instance, 
it is standard practice to proceed formally, as above, and then attempt to verify 
that the resulting series has the required properties. This method will be illustrated 
in some detail in the next chapter. 


EXAMPLE 1. Let 8 be the subspace of 6 0, π] described by the boundary con- 
ditions y(0) = γ(π) = 0, and let L = —D?. Then 


An =n, ~— gn(X) = Sin nx, 


n= 1,2,..., and the ¢, are a basis for C[0, x]. (See Section 9-5.) Hence the 
boundary-value problem 
—y" = AG), 


y(0) = y(n) = 0 poi 
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has the formal solution 
“1 Cn: 
y(x) = »» 72 Sin MX, (12-33) 


with 


C= 2 | h(x) sin nx dx. 
πιο 


In this case the validity of (12-33) can be guaranteed by demanding that h be 
continuous and have a piecewise continuous first derivative on [0, 7]. For then 
the Fourier sine series for A will converge uniformly and absolutely on every closed 
subinterval of (0, x), and the same will therefore be true of the series obtained by 
twice differentiating (12-33) term-by-term.* | 

As a concrete illustration, let h(x) = x. Then (12-32) becomes 


ay" = x, 


yO) = y(n) = 0, on 


and we have 


fe @) 
_ Chis 
y(x) = ) 72 Sill ΠΧ, 


n=1 


where 
τ 
2 
S24 x sin nx dx. 
πο 


A routine calculation gives 
2 
Cn, = (-- 1) 1! n 5 


whence 
n+1 SIN Nx 


yx) = 2) (τς 
n=l 


Of course, (12-34) can also be solved in closed form by applying the given 
boundary conditions to the general solution of y’” = —x. Lest the reader feel 
that we have been somewhat dishonest in using Fourier series when this easier 
method was at hand we point out that frequently no such option exists, and the 
only available solutions are those expressed as series in terms of eigenfunctions 
for the problem. 


* The reader should note that (12-33) will satisfy the given boundary conditions and 
reduce to the value of ἡ at 0 and a only if A(0) = A(r) = 06. Thus, in general, we can 
neither demand nor expect the solution of (12-32) to satisfy the differential equation on 
the closed interval [0, 7]. 
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The technique used in the above example was successful precisely because the 


operator — D? had a sufficient number of mutually orthogonal eigenfunctions 
when restricted to ὃ to allow us to construct an eigenfunction basis for @[0, 7]. 
This immediately raises the problem of determining conditions which are sufficient 
to guarantee the existence of such a basis for an arbitrary self-adjoint linear dif- 
ferential operator acting on a given subspace of 6 ἴα, δ]. As might be expected, 
this is a very difficult problem, and any attempt to answer it, even for the sym- 
metric operators introduced in Section 12-5, would carry us too far afield. Thus 
we let matters rest with the statement of the following theorem which, as it turns 
out, is adequate to handle most of the problems we shall discuss. 


Theorem 12-7. Let L be a normal second-order linear differential operator 
defined on a closed interval [a, Ὁ], and let 8. be a subspace of @{a, b] described 
by a pair of unmixed boundary conditions. Then L has an infinite sequence 
of real eigenvalues {\,},n = 0,1,2,..., such that 


Aol < Ιλ} « Ιλ 2] < +t 
and 
lim |A, = οὐ. 


Moreover, the invariant subspaces of C[a, b] associated with the ,, are all 
one-dimensional; any complete set of eigenfunctions for L, one for each 
eigenvalue, is a basis for @[a, b]; and the series expansion of any piecewise 
smooth function y on [a, b] relative to such a basis converges uniformly and 
absolutely to y on any closed subinterval in which y is continuous.* 


EXERCISES 


Find the formal series expansion of the solution of the boundary-value problems in 
Exercises 1-6 in terms of the eigenfunctions for the associated Sturm-Liouville system. 


1. 
2: 


3: 


ee 


ay 


y 


= x(x — 27), y(0) = 0, γ΄) = 0 
=x? — 7%, y'(0) = 0, γα) = 0 


sin γι) = 0, y(L) = 0 


sin“=> y(0) = 0, y(Z) = 0 
--χ, 0 “χ < 7/2, 


χ -- π22, 1/2 <x < π, γ00) ΞΞ 0, y(r) = 0. 


= —sin? x, y(0) = γ(πσ), γ'(0) = y'(x). 


Use the technique introduced in this section to discuss the boundary-value problem 


y” τι —h(x), 
γ(0) = y(2r), γ΄ (0) = γ΄ (2π), 


* For a proof see E. L. Ince, Ordinary Differential Equations, Dover, New York, 1956. 
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given that A is a function in C[0, 27]. [Hint: Consider the cases 


2π 2π 
i h(x) dx = 0 and [ h(x) dx # 0 
0 0 


separately. ] 


*8. By citing appropriate theorems in the text, verify the assertion made above concern- 
ing the convergence of the series given in (12-33). 


12-8 ORTHOGONALITY AND WEIGHT FUNCTIONS 


The considerations of the preceding section admit an easy and important general- 
ization to boundary-value problems involving a Sturm-Liouville system con- 
sisting of 

(i) a second-order homogeneous linear differential equation of the form 


τ. (pe) #) + [4(Χ) — λγ( ὴν = 0 (12-35) 


defined on an interval [a, δ], and 
(ii) a pair of homogeneous boundary conditions which serve to determine the 
domain space for the operator 


L = D(p@)D) + gq». 


As before, we assume that p and q belong, respectively, to @'[a, b] and C[a, δ], 
and that p(x) does not vanish in (a, δ). In addition, we demand that r be a con- 
tinuous , non-negative function on [a,b] which vanishes at most finitely many 
times in the interval. 

The values of \ for which such a problem admits nontrivial solutions are again 
called eigenvalues and the associated nontrivial solutions of (12-35) are called 
eigenfunctions. Our task, of course, is to find all eigenvalues and eigenfunctions 
once L and its domain space have been given, and, more generally, to investigate 
the possibility of extending-our earlier results to this setting. 

We begin by noting that if \, and dg, are distinct eigenvalues for (12-35), and 
if γι and ys are eigenfunctions belonging to these eigenvalues, then 


Ly, = dAar(x)yix), 
Lye = dar(x)yo(x), 


and Lagrange’s identity implies that 


(Ar — Az)r(x)yi(x)yo(x) 


» ΣΕ γι ΟἹ] — GLI 
= ὦ {ραχνιοῦνέοῦ -- yD 
Hence 


Οἱ — 2) [rn COra) de = PCOMLGME) -- wOMGI), (12:36) 
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and it follows that 
b 
[ r@dyi@ya(x) dx = 0 (12-37) 


whenever the boundary conditions are such that the expression on the right-hand 
side of (12-36) vanishes. Assuming this to be the case, (12-37) allows us to assert 
that the functions ./ry; and +/ry2 are orthogonal in @[a, b], or, equivalently, 
that y, and ye are orthogonal in C[a, δ] with respect to the weight function r. (See 
Example 3, Section 7-1.) This latter terminology has the advantage of banishing 
the cumbersome factor +/r from the discussion of orthogonality, and amounts to 
redefining the inner product on C[a, δ] to be 


fig = f° fledg(xr(x) de, (12-38) 


a definition we know to be valid whenever r satisfies the conditions imposed above. 
And with this we have proved the following generalization of Theorem 12-6. 


Theorem 12-8. Let L be a self-adjoint linear differential operator on an 
interval [a, δ], let r be any weight function on [a, b], and let 8 be a subspace 
of Θ᾽ ἴα, b] such that 


PD (x)y5(x) — ΡΟΝ = 0 


for every pair of functions y, and ye in 8. Then any set of eigenfunctions 
belonging to distinct eigenvalues for the Sturm-Liouville problem 


Ly = »ry 


is orthogonal in C[a, δ] when the inner product is computed with respect to 
the weight function r. 


We call the reader’s attention to the fact that in general the operator L will not 
be symmetric on ὃ with respect to the weighted inner product defined by (12-38). 
Nevertheless, Theorem 12-8 asserts that eigenfunctions belonging to distinct 
eigenvalues are still orthogonal, and this is really what is needed to construct 
eigenfunction bases. Moreover, since the conditions required to ensure orthog- 
onality here are the same as those imposed in Section 12-5, we see that the 
conclusion of Theorem 12-8 is assured whenever ὃ is described by boundary 
conditions of Type 1, 2, or 3 of that section. And finally if L: 8 > 6[α, δ] is 
both one-to-one and normal, and if r(x) > 0 for all x in [a, b], it can be shown 
that C[a, δ] has a basis composed of eigenfunctions for L. Again we omit the 
proof. 


EXAMPLE. Find the eigenvalues and eigenfunctions for the Sturm-Liouville 
problem 
») + 4ν + (4 — )y = 0, 


yO) = y(a) = 0. (12-39) 
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In the first place, (12-39) can be rewritten in self-adjoint form as 


4 4: dy AP 4x 
ἘΞ (. ΦῚ + 4. “ν = λί(θε ν, 


y0) = 06, (a) = Ὁ, 


and therefore satisfies the hypotheses of Theorem 12-8. Thus eigenfunctions 
belonging to distinct eigenvalues for this problem will be mutually orthogonal in 
the Euclidean space @[0, a] with inner product computed relative to the weight 
function r(x) = 9e4*. Furthermore, it is not difficult to show that the operator 
L = D(e**D) + 4e** is a one-to-one linear transformation from the subspace 
described by the given boundary conditions to C[0, a]. (See Exercise 5, Section 
12-2, and Lemma 12-3 below). Hence, since Z is normal and r(x) > 0 for all 
x in [0, a], the result cited a moment ago guarantees the existence of an eigen- 
function basis for C[0, a]. To compute such a basis we argue as follows. 


Case 1. > 0. Here the general solution of γ΄ + 4y’ + (4 — 9A)y = 0 15 
pe τῦΣ ΕἾ OPP ἀν... 


y = 
and the boundary conditions imply that 
Ci Ἔ Co = 0. 


ernst 2a coe’ 23 ya =) 


Thus ει = Co = 0, and (12-39) has no positive eigenvalues. 
Case 2.\ = 0. This time the general solution of the equation is (cy + Coxe **, 


and we again find that cy = cg = 0. 
Case 3. < 0. Here 
y = ec, sin 3\/—A xX + C2 c0s 3V/—X x), (12-40) 


and the requirement that y(0) = y(a) = 0 yields 


Co = 0, 
οι 51η 3ν, --λα = 0. 


Hence (12-39) has nontrivial solutions if and only if » satisfies the equation 
sin 3,/—\ a = 0, and it follows that the eigenvalues for this problem are 


2,2 


An = —~ 9Q2 


ae ae ey ee 


To find a corresponding set of eigenfunctions we now set οι = I, ἐφ = 0, and 
\ = λ, in (12-40), thereby obtaining the functions 


on. NX 
yn(x) = ε΄“ sin : 


ee ey eee 
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EXERCISES 


Compute the eigenvalues and eigenfunctions for the boundary-value problems in Exercises 
1-8, and in each case determine a Euclidean space in which a complete set of eigenfunctions 
for the given problem is an orthogonal set. 


ly’ + +A) =0; yO) = 0, yr) = 0 

yy’ + --ὴν = 90; WO) = 0, yw) = 0 

y+ 2y + Ud —rNy = 90; yO) = 0, νγᾷ) = 0 

.}" — 4γ + 4 -- δ)ν = 0; vO) = 90, γα) = 0 

. Ay” — 4y' + A+ Ay = 0; γ(-1)ὴ = 0, γᾷ) = 0 

yy’ + —-Ay = 0; yO)+ yO =90, νά) + γ) = 0 

y+ ay + ( -- Ny = 90; yO) = 0, γα) = 0 

. )" — 3+ 20+ λ)ν = 0; yO) = 0, yl) = 0 

*9. Find all eigenvalues and eigenfunctions for the “‘singular’’ Sturm-Liouville problem 


aon KN A HR ὦ NO 


xy’ — xy + (1 + dy = 0, 


given that y(1) = 0, and lim,_,o+ |y()| < 2%. How does the set of eigenvalues of 
this problem differ from those encountered earlier in this chapter? [Hint: Note that 
the given equation is an Euler equation, and recall that when its indicial polynomial 
has complex roots a + Bi, the solution space on (0, ©) is spanned by the functions 
χα sin (8 In x), x* cos (6 In x).] 


10. Repeat Exercise 9 for the boundary-value problem 
x2y"’ + xy’ — Oy = 0, 


γα) = 0, lim, |y@)| < ο. 
z— 0 


*12-9 GREEN’S FUNCTIONS FOR BOUNDARY-VALUE PROBLEMS: 
AN EXAMPLE 


In an earlier chapter we saw that the equation 
Lx ='y, 175 — 0, (12-41) 


can be solved for x by “inverting the operator’? whenever L 1s a one-to-one linear 
transformation mapping ὃ onto U. For, under these conditions, there exists a 
linear transformation L—' from V to 8 such that LL~/ = J, J the identity map 
on 8, and hence x = L~'y. In the sections which follow we shall apply this 
technique to the case where (12-41) is a boundary-value problem involving a normal 
self-adjoint linear differential operator and unmixed boundary conditions, thereby 
obtaining a method for solving such problems which is independent of the elab- 
orate theory of series expansions in Euclidean spaces. 
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The best place to begin, perhaps, is at the point where we left the discussion of 
initial-value problems in Chapter 4. As the reader will recall, we saw there that if 


1: @*{a, b] — C[a, δ] 


is a normal second-order linear differential operator, and if ὃ 1s the subspace of 
@*[a, δ] consisting of all functions y which satisfy the initial conditions 
γ(Χο) = Yo, 70) = V1; 


then L, restricted to 8, has an inverse which can be expressed as an integral operator 
of the form 


τοὺ -- [ ” K(x, Dnt) αἱ. 


Moreover, the function K(x, ἢ, known as the Green’s function for Z for initial- 
value problems, can be constructed in a perfectly definite way from the coefficients 
of L and a basis for the null space of L in 6 ἴα, b]. Our present objective is to 
prove that a similar construction is possible whenever 8 is a subspace of 6 ἴα, δ] 
determined by a pair of unmixed boundary conditions 


aiy(a) + agy’(a) = 0, 


(12-42) 
Biy(b) + Boy’(b) = 9, ‘ 


and L is one-to-one when restricted to 8. 

Obviously then, our first task is to devise a criterion which will guarantee the 
one-to-oneness of L. In other words, we must impose restrictions on the boundary 
conditions appearing in (12-42) which will ensure that the only solution of the 


equation 
Ly = 0 (12-43) 


which belongs to 8 is the trivial solution y= 0. This can be done as follows. 
Let y, and yg be a basis for the null space of L in 6 ἴα, b], and let 


W(X) = €1V1(%) + Coya(x) 


be the general solution of (12-43). Then y(x) will be identically zero if and only 
ifc, = Co = 0, and y(x) will belong to 8 if and only if 


aileryi(a) + coye(a)] + acfciyi(a) + coye(a)] = 0, 

Bilery1(b) + coy2(b)] + Beleryi(b) + cay2()] = 9, 
that is, if and only if 

ci[ayyi(a) + azy{(a)] + colaiye(a) + a2yo(a)] = 0, 

ci[81y1(b) + Beyi(b)] + ce[Biye(b) + Boy2(b)] = 0. 


(12-44) 
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Viewing (12-44) as a pair of equations in the unknowns c, and Cg, it follows that 
y(x) = 0 if and only if (12-44) has the unique solution cy = cg = 0. From this, 
and the elementary theory of systems of linear equations, we immediately deduce 


Lemma 12-3. Let L be a normal second-order linear differential operator 
defined on an interval [a, δ], let γὶ and yz be a basis for the null space of L 
in ©*[a, δ], and let 8 be the subspace of Θ΄ Ἴα, δ] determined by the unmixed 
boundary conditions in (12-42). Then L will be one-to-one when restricted 
to 8 if and only if the determinant 


a1y1(@) + a2yi(a) = ay oa) + aayo(a) (12-45) 
Biyi(b) + βογι( ὃ) βινε(δ) + Beyo(d) 
is different from zero. 
EXAMPLE. Let L = D7”, and let 8 be the subspace of 6 ἴα, δ] defined by 
y(a) = 0, y(b) = 0. (12-46) 


Then using the functions 1, x as a basis for the null space of L, the above deter- 
minant becomes 


l a 


Ι Ὁ 


= b— a, 


and it follows that ZL is one-to-one on 8. 

In this case we can also prove that L maps 8 onto C[a, Ὁ] by the simple expedient 
of constructing L~' directly from the formula for L. Indeed, since the equation 
Ly = his simply y’’(x) = A(x), two integrations yield 

ys) = | nar +e 


and 


y(x) = i | h(t) a ds + c(x — a) + d, (12-47) 


a 


where c and d are arbitrary constants. Applying the given boundary conditions 
we find that d = Ο and that 


br rs 
EU nia) dt| ds + cb — a) = 0. 
C= of [f morales, 


Thus 
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and (12-47) becomes 


x 8 b 8 
voy = | || κα: — * = | ῇ ne) αἱ as 


We now use the unit step function 


ug(s) = ἢ — 


to rewrite this expression as 


b 8 ὃ 8 
vo) = [μὰ - 9| f no atlas —2= 4 [{{ h(t) dt ἀν 
b 8 
Ξ 1 {| ὦ [μα — ὁ — X=] af as 


Using the unit step function again, we have 


by, pb 
y(x) = : {| μοί — ft) re -- 5) - ; -- a h(t) αἱ ds 


by pb 
= : {| Ug(s — ἡ ots Ξ 8} 5Ξ ; - Ἴ as A(t) dt, 


and it follows that 


b 
γι) = | K(x, t)h(t) dt, (12-48) 


where 


δ 
K(x, ἢ = | Ug(s — ὃ ots — 5) -- ; - | ds 


@ — at — δ). x <t, 


x ope (12-49) 


& — OM τ ὦ, oi 


(See Exercise 3.) The function K(x, ἢ defined by this formula is known as the 


Green’s function for the operator L = D? for the given boundary-value problem, 
and Eq. (12-48) can be read as the definition of L~*: 6[α, δ] — ὃ with 


L(x) = f K(x, tnt) dt. (12-50) 
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In the next section we shall prove that an analogous result is valid for any normal 
second-order linear differential operator L acting on ὃ so long as ὃ is determined 
by a pair of unmixed boundary conditions, and L is one-to-one when restricted 
to ὃ. 


EXERCISES 


1. Determine which of the following operators are one-to-one when restricted to the 
given subspace 8 of C2[a, δ]. 


(a) L = D?+4D+4+4 (b) L = D? +1 

δ: y0) = 0, y@ = 0 δ: γ( --πὴ) = 0, yr) = 
(c) L = D2 —1 (Ὁ L = D2? —1 

δ: yO) + γ΄(0) = 0, γί = 0 δ: y(0) — γι) = 0, y¥@ = 


(0) L = χρέ +xD+1 
δ: γα) = 0, y(e™) = 
2. Show that if the condition in Lemma 12-3 is satisfied for a pair of functions y; and 


y2, it will also be satisfied for every other pair of linearly independent functions of the 
form 


Yi(x) = Yiyi(x) + Ὑ2»20)), 
Yo(x) = Yayi(x) + Yayo(x). 
3. Prove that 
(x — a)(t — δ) 


b 
x—a b-—a 
[μὰ — [uote —  - $=] a - (x — bt — a). 
b-—a 


IA 


IV 


where uo is the unit step function, anda < x < ba<t <b. 


4. Prove that the first derivative with respect to x of the Green’s function K(x, ὃ) con- 
structed above has a jump discontinuity of magnitude 1 along the line x = ¢, but is 
continuous at all other points in the regiona < x < ba<t<b. 


5. Let to be a fixed point in the interval [a, δ], and let K(x, ὃ be the Green’s function 
constructed above. Prove that the function K(x, fo) is a solution of the boundary- 
value problem 


y(a) = γ(δ) = 0, 
for all x ¥ fo. 


6. Use the technique introduced above to find the Green’s function for the operator D? 
on the subspace of C?[0, 1] defined by the boundary conditions y(0) = y’(1) = 


7. Repeat Exercise 6 for the boundary conditions 


y(0) — γ'(0) = 
yl) + yw’) = 0. 
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8. Let 8 denote the subspace of C?[a, b] determined by the periodic boundary conditions 


y(a) = y(d), 
y'(a) = γ' (ὁ). 


and let L = D( p(x)D) +- g(x) be normal on [a, ὁ]. Prove that L is one-to-one when 
restricted to ὃ if and only if 


γι(α) — γι() ~— 2a) — ye(d) 


Nas). ἰῷ =o” 


whenever y; and y2 are linearly independent solutions of the equation Ly = 0. 


*12-10 GREEN’S FUNCTIONS FOR BOUNDARY-VALUE PROBLEMS: 
UNMIXED BOUNDARY CONDITIONS 


Throughout this section we shall assume that L = D[ p(x)D] + q(x) is a normal 
_ second-order linear differential operator defined on an interval [a, δ], that $ is a 
subspace of C*[a, δ] determined by a pair of unmixed boundary conditions, and 
that L is one-to-one when restricted to 8. As was stated above, we propose to 
show that such a transformation necessarily maps ὃ onto C[a, δ], and admits an 
inverse which can be expressed as an integral operator of the form 


Lh) = | ” K(x, th(t) dt 


for all A in C[a, b]. In order to motivate the axiomatic definition of the function 
K(x, t) given below, we begin by presenting a heuristic argument which will 
simultaneously suggest the existence of L~', the validity of the above formula, 
and, most important of all, the correct determination of K(x, t).* 

Assume that the equation 


Ly -- ἢ (12-51) 


describes the behavior of a physical system under the influence of a given input 
function h, and assume, in addition, that the response y(x) of the system at the 
point x due to the unit input 

Ι ifx =f, 
ex) = \ ifx γέ t, 


is K(x, t).+ Then, in view of the linearity of Z, it is reasonable to expect that the 


* The following argument is essentially the one given by R. Courant and D. Hilbert in 
Methods of Mathematical Physics, Vol. 1, Interscience Publishers, Inc., New York, 1953. 

+ For instance, (12-51) might be the equation of equilibrium of an elastic string 
stretched along the interval [a,b] and subjected to a continuously distributed force 
h = h(x). In that case, φι(χ) represents a unit force applied at the point ¢, and K(x, ἢ 
the deflection of the string at x due to this force. 
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response of the system at x to a unit input applied continuously throughout the 
entire interval should be obtained by “summing” the responses due to unit inputs 
applied at each point of the interval, and hence should be of the form 


b 
y(x) = [ K(x, t) dt. 
In the case of a general input function h, this reasoning leads to the formula 
b 
γα) = [ K(x, τκ(ὺ dt, (12-52) 


where the integrand is now viewed as the response at x to that portion of the 
input applied at the point ¢. 

Granting the validity of these considerations, we can easily deduce a number of 
properties of the function K(x, ἢ). In the first place, it is clear that K(x, 4) must 
be defined and continuous for a < x < b,a < t < b, and, for each value of 1, 
must satisfy whatever boundary conditions have been imposed on the problem. 
Moreover, by its very definition, K(x, 1) is a solution of the equation 


Ly = (x), 


and hence, for each fixed fo in [a, 6], the function K(x, to) satisfies the homo- 
geneous equation 
Ty = 0 


for all x τέ to. Finally, to determine the behavior of K(x, to) when x = fo, let 
fio denote the function which vanishes outside the interval |x — fo| > ε, and 
which contributes a total input of one in the interval |x — to| < ε; that is, 


tote 
[ τ fig(X) dx = 1. 
o—é 


(We assume that € has been chosen sufficiently small so that the interval [to — €, 
to + €] is contained in [a, b].) Then, if K(x, to) denotes the response of the sys- 
tem at x to f;,, we have 


L[K(x, to)] ἘΞ Sto(X), 
and it follows that 


tote 
/ L[K(x, to)] dx = 1. (12-53) 


tg—e 


But, by assumption, L = D[p(x)D] + q(x), whence (12-53) becomes 


1 ε d tote 
| τοῖροῦκια, to)| dx + in q(x)K(x, to)dx = 1, 


Or 


tote tote 
P(x)K"(x, to)| Ὁ / q(x)K(x, to) dt = 1. (12-54) 
to—e tg—e 
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We now make the not unreasonable assumption that as ε — 0, K(x, to) — K(x, to) 
for all x, and that K’(x, to) — K’(x, to) for all x different from to. Then the 
continuity of g and K imply that the second term in (12-54) vanishes as ε — 0, 
while the first reduces to 


i 
2 
P(to) Ε Κα, | 
Thus 
d oy 
Br) eas 12-55 
ἐς 6 10). = 5G) sta: 


an equation which asserts that at the point fo the derivative of K(x, to) has a jump 
discontinuity of magnitude 1/p(to). 

Although these considerations are admittedly nonrigorous, they do agree with 
the results obtained in the preceding section (see Exercises 4 and 5, Section 12-9), 
and serve to motivate the following definition. 


Definition 12-5. A Green’s function for the boundary-value problem L: 8 > 
@[a, δ] described above is a function K(x, 1) of two variables satisfying the 
following three conditions: 

(1) K(s, t) is defined and continuous fora < x < b,a < t < ὃ, and, 
as a function of x, is twice continuously differentiable except when x = 1£; 

(2) For each fixed fg in [a, b], K(x, to) belongs to the subspace ὃ (Le., 
satisfies the boundary conditions imposed on the problem), and, in addi- 
tion, is a solution of the equation Ly = 0, except at the point x = fo; 
tt 

1 


G) “Καὶ = a5" 


With this as our definition, we now state the following basic theorem. 


Theorem 12-9. Jf L: 8 — C[a, b] is a boundary-value problem of the type 
described at the beginning of this section, and if L is a one-to-one mapping 
of 8 into C[a, Ὁ], then L maps 8 onto C[a, b], and for each h in C[a, δ] the 
(necessarily unique) solution in ὃ of the equation 


[Ty=h 
is given by the formula 


b 
y(x) = [ K(x, t)A(t) dt, 


where K(x, t) is a Green’s function for L. Moreover, K(x, t) is uniquely deter- 
mined by the operator L and the boundary conditions which define the sub- 
space ὃ. 
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We defer the proof of this result to the next section in favor of showing how the 
Green’s function for L can be explicitly computed once L and ὃ are known. Here 
we argue as follows. 

Let γι and yz be solutions of the homogeneous equation Ly = Ὁ chosen so 
that y, satisfies the boundary condition imposed at x = a, and γὼ. the boundary 
condition imposed at x = 5; that 1s, 


a1yi(a) + agyi(a) = 0, 
Biyo(b) + Boye(b) = 0. 


(See Exercise 1 for a proof that such solutions do, in fact, exist.) Then y,; and yo 
are linearly independent in 6 ἴα, δ]. For otherwise, there would exist a constant 
c % 0 such that yo(x) = cy,(x), and the function cy,(x) would be a nontrivial 
solution of Ly = 0 satisfying both of the boundary conditions imposed on 8. 
This, however, contradicts the assumption that 1, is one-to-one when restricted 
to ὃ, and is therefore impossible. 

We now use the fact that the Wron- A (to)y1(x) 
skian of y, and γὼ never vanishes on the Aa(to)v2(*) 
interval [a, δ] to find functions A,(¢) and 
A(t) such that 


Ag(t)y2(t) — Ai@Myi(t) = 9, 


AQ(t)yi(@) — Aiayi() = 


| 
| 
| 
| 
| 
| 


Ϊ {5 ι τ π΄ τνὺνῦ-- 
p(t) a lo b 
(12-56) FIGURE 12-3 


for all ¢ in [α, δ]. The first of these equations guarantees that for each fo in the 
interval (a, δ) the curves A 1(to)y1(x) and A o(to)y2(x) intersect at the point x = fo 
(see Fig. 12-3), while the second guarantees that the slope of A(t o)yo(x) differs 
from the slope of A,(to)yi(x) by 1/p(to) at x = to. Thus the function 


A, (t)yi(), x < ΐ, 
A (t)yo(x), x > ΐ, 


satisfies the various conditions imposed in Definition 12--5, and is the Green’s 
function for L. Finally, by solving (12-56) for A; and 4. we obtain the formula 


K(x, ὃ = | (12-57) 


V1(x)yo(t) 


K(x, ὃ = PMODid)ye® — yvid)ye@] | (12-58) 


yilt)yo(x) 
PODiOy2) -- vriyeO] 
Remark: The argument just given provides a rigorous proof of the existence 


of a Green’s function for the problem under consideration. Uniqueness will be 
established in the next section. 


<4, 


9 
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EXAMPLE. Let L = δ, and let 8 be the subspace of 6 ἴα, δ] for which 


y(a) =y(b) = 0. 


Then, as we know, L is one-to-one when restricted to 8, and Theorem 12-9 
applies. To find the Green’s function for L on ὃ we set 


για) π- χ τ a yolx) = x—b 


in (12—58), to obtain 
α -- αγχίί -- ὃ), Le, 


K(x, ὃ = a: 7 
( -- α)ο: -- 5), ,, 
b-—a pate 


in agreement with the formula found in Section 12-9. 


EXERCISES 
1. Prove that the equation Ly = 0, Las above, has a pair of solutions y; and y2 such that 


a1yi(a) + aeyi(a) = 0, 
B1y2(b) + Boye(b) = 0. 


[Hint: Use the existence theorem for solutions of initial-value problems.] 


2. Use the method of this section to obtain the Green’s functions for the boundary-value 
problems of Exercises 6 and 7 of the preceding section. 


3. (a) Find the Green’s function for the boundary-value problem 
y’+k*¥y=0, yO) = yl) = 0. 
(b) Use the result in (a) to find the solution of 
»" + k?y = h(x), γ00) = γ() = 9, 


given that ᾧ belongs to @[0, 1]. 


*12-11 GREEN’S FUNCTIONS: A PROOF OF THE MAIN THEOREM 


Continuing with the notation introduced above, we now show that Definition 
12-5 does, in fact, uniquely characterize the Green’s function for L. This is the 
content of 


Lemma 12-4. Let L = D[p(x)D] + q(x) be a normal second-order linear 
differential operator on [a, b], and let H(x, t) and K(x, t) be two functions 
satisfying Definition 12-5. Then H(x, t) = K(x, t) for all x and t in [α, δ]. 
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Proof. Let to be any point in [a, δ], and set F(x) = A(x, to) — K(x, to). Then 
F and F’ are continuous for all x 1n [a, δ], and 


L(F) = L(A — K) = L(A) -- L(K) = 0 (12-59) 
for all x + fo.* Furthermore, by applying L to F and solving the identity 
POX)E" + p'(xX)F’ + qQx)F = 0 


for F’’, we conclude that F’”’ exists and is continuous on [a, Ὁ], and hence that F 
belongs to @7[a, δ]. Finally, since H(x, to) and K(x, to) belong to the subspace 8, 
the same is true of F, and (12-59) together with the fact that L is one-to-one when 
restricted to ὃ now implies that F(x) = 0. Hence A(x, to) = K(x, to) for all x, 
and since fy was arbitrary in [a, b], the proof is complete. J 


At this point we are in a position to assert that every boundary-value problem 
L: 8 — @[a, b] involving a normal second-order linear differential operator 
which is one-to-one on the subspace § has a unique Green’s function K(x, ἢ and 
that this function is given by Formula (12-58). Thus to complete the proof of 
Theorem 12-9 we need but show that the function 


b 
y(x) = i K(x, tyh(t) dt 


belongs to ὃ and satisfies the equation Ly = Ah, for every h in C[a, 6]. 
To this end we write 


Ce b 
y(x) = / K(x, t)h(t) dt + | K(x, th t) dt, 
and differentiate to obtain 


y'(x) 


K(x, x)h(x) + [ ~ K(x, t)h(t) dt 


b 
~ K(x, Dh) + / ~ K(x, A(t) dt 


b 

0 
/ ὃ. K(x, t)h(t) dt. 
(See Appendix I.) Thus 


b 
ayy(a) + aey'(a) = [ ἰαἰκία, t) + a2 = K(a, ») h(t) dt 
= 0, 


* Strictly speaking, F’ has a removable discontinuity at x = to, which we can ignore 
because the discontinuities in H and K cancel by subtraction. 
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the last step following from the fact that, as a function of x, K(x, ἢ) belongs to $ 
for each ¢ in [a, δ]. Similarly 


Biy(b) + 82» (δ) = 9, 


and y(x) does belong to 8, as required. 
Finally, 


x b 
y"(x) = cal / ~ K(x, t)h(t) dt + : = Κα, t)h(t) a 


* nd 
Ι ὡς K(x, t)h(t) dt + ᾿ (x, x h(x) 


b 
a? OK Ὁ 
ΕΞ | 55: K(x, AE) dt — 5 (x xh) 


ae 
= [ os K(x, t)h(t) dt + h(x) ek (x,x-) -- st (x, | . 


But, referring to Fig. 12-4, we observe that the 
continuity of 0K/dx in triangle ABC implies 


Similarly, using triangle ABD, we obtain 


OK _, _ OK, 4 
Ox (x, x ) = ax (x 9 x), 
and it follows that πο FIGURE 12-4 
aK, ὃ, 4, 0K; 4. dK, 
9x α, Χ) — oy Ge) = BEG . Χ) ay (ἃ , x) 
— aoe 3 
p(x) 


the prescribed jump in 0K/dx at the point (x, x). Thus 


ΠνΑΟῚ = p(x)y"(x) + p’(x)y'(x) + ax) y(x) 


I 


: 2 
nay + | [rc 2 Ko. + νῷ 3. καὶ + aeOKC 0] MO d 


b 
h(x) + / LLK(x, ἡμὴ dt, 


12-11 | GREEN'S FUNCTIONS: PROOF OF THE MAIN THEOREM 503 


and since L[ K(x, t)] = 0 for each ¢ in [a, δ], 
L{y(x)] = A(x), 
and we are done. J 
As our final result on Green’s functions, we now prove 
Theorem 12-10. If K(x, t) is the Green’s function for the boundary-value 


problem L: 8 — Θ[α, b] described above, then K(x, ἢ = K(t, x) for all x and 
all t. 


Proof. Let so and fo be fixed points in [a, b] (with to < so), and setu = K(x, So), 
v = K(x, to). Then Lu = Lv = 0 for all x in [a, δ] different from 50 and fo, and 
the Lagrange identity applied to u and v yields 


ἀρῶν — μῃ - 


We now integrate this expression from a to b, taking account of the discontinuities 
of μ' and v’ at 50 and fo, to obtain 


to 


ΠΕΣ (x, to) Κύ,, So) — ot 6, So) > K(x, roll 


80 


+ p(x) [5 (x, to): K(X, 50) — oF Os 50)" KG, By) it 


b 


+ p(x) = (x, to) - K(x, So) — a (x, So) + K(x, 1) Η 


-- Thus 
γί) ὃ (to, to) - K(to, So) — = a (ed » to): K(to, "ἢ 
a OK, _ 
+ ps0) | 5 ἘΞ * οὐ » So) ° K(So, to) — Ox (so, So) * K(So, to) 
ΘΚ 
+ ae (ὁ, to) - ΚΟ, so) — ae --- (δ, 50)" Κί, 1) 
ΘΚ 
par p(ay| 2X (a, to)° K(a, So) — ax —— (a, So) ἥ Κία, 1) = 
But, using the known jumps in 0K/dx, this expression can be rewritten 


~K(to, 0) + K(s0, to) + p(6)| 2X (6, 10): KG, 50) — 2 6, 50) KO, - 


= p(ay| 2 (a, to) - K(a, So) — ok (a, So) K(a, to)| = 0 
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Finally, using the boundary conditions 
a K(a, to) = 


a1 K(a, So) = 


and 


βικΚί(, to) = 


6, K(6, So) τ᾿ 


we see that the bracketed terms vanish. 


12 
OK 

τ a2 Ox (a, to)s 
OK 

— a2 ax (a, So), 


OK 
— Bo ax (ὁ, to), 


OK 
— Bo Ox (δ, to), 


Thus K(5so, to) = K(¢o, 50), aS asserted. ἢ 
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boundary-value problems for 


partial differential equations: 


the wave and heat equations 


13-1 INTRODUCTION 


Historically the theory of boundary-value problems grew out of the study of certain 
partial differential equations encountered in classical physics, and many of the 
ideas treated in this book originated in attempts to solve these problems. For this 
reason, if for no other, any introduction to the subject of boundary-value problems 
would be incomplete without a discussion of partial differential equations. But 
there are, in fact, compelling reasons for pursuing this subject which are quite 
unrelated to any feelings of historical nicety. And though these reasons are 
bound to become obvious as the chapter unfolds, it may not be out of place to 
mention some of them before we begin. 

For one thing, this discussion will serve to unite the various results on eigen- 
functions and orthogonal series expansions that have been obtained in the pre- 
ceding chapters, bringing them into sharper focus, and reenforcing the point of 
view which sees them as a unified body of mathematical thought. For another, 
we will at last be in a position to consider nontrivial physical problems, and the 
fact that they can be solved with comparative ease should increase the student’s 
appreciation for the power of the techniques we now have at hand. And finally, 
this material will in its turn suggest further problems leading to new results in the 
subject. 


13-2 PARTIAL DIFFERENTIAL EQUATIONS 


The definition of a linear differential operator given in Chapter 3 can easily be 

extended to include operators which involve partial differentiation. Such opera- 

tors act on vector spaces whose members are functions of several variables, and 

their associated operator equations are known as /inear partial differential equa- 

tions. Thus if @'(R) is the space of all continuously differentiable functions 
505 
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defined in a region R of the xy-plane, the most general first-order linear differential 
operator defined on @'(R) has the form 


L = a(x, y)Dz + B(x, »)Dy + 6%, 9) = ale 3x + BRE + oy), 


where a(x, y), b(x, y), c(x, y) are continuous everywhere in R. Here L may be 
viewed as a linear transformation from @'(R) to C(R), the space of all functions 
continuous in R, and if 1 15 any preassigned function in C(R), the equation Lu = ἢ, 
u unknown, 1s a first-order (linear) partial differential equation. 

It is clear that analogous, but more cumbersome formulas can be given for linear 
differential operators (and equations) of higher order involving any number of 
variables. Moreover, it is equally clear that all of the standard facts pertaining 
to linearity continue to hold in this more general setting. This not withstanding, 
the general theory of linear partial differential equations has very little in common 
with that of ordinary equations for the simple reason that the solution space of 
every (homogeneous) linear partial differential equation is infinite dimensional. 
For instance, it is not difficult to show that the general solution of the first-order 
equation 


~+“%=0 (13-1) 


is u(x — y), where μ is an everywhere differentiable but otherwise arbitrary 
function of a single variable. From this it follows that each of the functions 


sin (x a 7) COs (x _ y), Eo”, (x = yy, α 


is a solution of (13-1), and it is clear that these functions are linearly independent 
in C(R) for any R. The fact that even so simple an equation as this has such a 
wealth of linearly independent solutions gives some indication of the difficulties 
which must be surmounted in the study of partial differential equations. 

These remarks go far to explain our insistence upon treating partial differential 
equations strictly within the context of boundary-value problems. For there the 
difficulties just mentioned vanish, and all of the problems we shall consider do 
have unique solutions. But before we go on to describe these problems in detail 
we must define what is meant by a solution of a boundary-value problem involving 
a partial differential equation. Surprisingly, this is not so easy as it sounds, and 
thus, for the sake of simplicity, we shall give the definition only in the two-dimen- 
sional case with boundary conditions involving a single function. Once this has 
been done the reader should have no difficulty in extending the definition to 
higher-dimensional regions and more complicated boundary conditions. 

In the particular case just mentioned the ingredients of a boundary-value 
problem are 


(i) a two-dimensional plane region R with boundary B, 
(ii) a partial differential equation defined everywhere in R, and 
(11) a function f defined on B. 
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As used here the word “‘region”’ is a technical term reserved to describe a connected 
subset of the plane each point of which can be surrounded by a circle lying entirely 
within the set in question.* Thus the upper half plane, an infinite or semi-infinite 
vertical strip of the plane, the interior of a rectangle, or the annulus between two 
concentric circles are all regions in this sense, and as such are typical of the two- 
dimensional regions in which boundary-value problems involving partial differential 
equations are defined. In addition, we shall assume henceforth that the boundary 
of each of the regions we consider is made up of a finite number of simple differ- 
entiable arcs in the sense of the definition given in Section 9-8.f 

Whenever (i), (ii), (iii) are given, the problem, of course, is to find all functions 
u = u(x, y) which satisfy the differential equation in R and reduce to f on B. 
(Note that we do not require u to satisfy the differential equation on 8.) But were 
this all that was required we could immediately solve the problem by letting u be 
any solution whatever of the differential equation in R and then redefining u on B 
to coincide with f. However, this clearly violates the spirit of the problem, and to 
ensure that it violates the letter as well we must impose some restriction which 
will guarantee that the values of u near B are related to the values of f on B. 
Although this can be done in a variety of ways, the constraining condition is 
usually taken to be one of the following: 


a. For each point by on B and each p in R, the limiting value of u(p) as p ap- 
proaches bo along any smooth curve in R is f(bo). (See Fig. 13-1.) 


B B 


FIGURE 13-1 FIGURE 13-2 


Ὁ. For each point bg on B and each p in R the limiting value of u(p) as p ap- 
proaches bp along any smooth curve in R which is normal to B at bg is f(bo). 
(See Fig. 13-2.) 

In practice the choice between (a) and (b) is reflected in the hypotheses which 
must be imposed on f to guarantee the existence of solutions of the desired type. 
Since the second of these conditions is less restrictive than the first, it allows 
theorems to be proved in greater generality and is therefore in wider use. It is the 
condition which we shall adopt in the following chapters. 


* A subset R of the plane is said to be connected or pathwise connected if every pair of 
points in R can be joined by a smooth curve lying entirely in R. 

{+ The boundary of a region R is, by definition, the set B of all points in the plane with 
the property that every circle centered at a point of B contains points in R and points 
not in R. 
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EXERCISES 


1. (a) Give the formula for the most general linear differential operator L: C!(R) — 
@(R) when R is a region of xyz-space. 


(b) Give the formula for the most general linear differential operator L: C?(R) > 
C(R) when R is a region of the xy-plane. 


2. Determine which of the following partial ar equations are linear. 


(a) pty 0 (b) wit tx HM δας snus 
Ὁ. ay ttyat eee ὦ [χε ἀπ). τον τ το 
(e) 4 + 55 + (xp)? = 0 

( δε OH aay (δες δ) ὼς οι 


3. (a) Show that u(x — y) isa solution of the partial differential equation u, + u, = 0 
whenever u is a differentiable function of a single variable. 
(Ὁ) Let F(x, y) be a solution of uz + uy = 0. Setp = x+y,q = x — y, and 


write F(x, y) as 
+ _ 
F(x, y) = F(? iS 4) -- σζρν 4). 


Show that G is actually a function of g alone by computing 0G/dp, and then deduce 
that every solution of u, + u, = 0 can be written in the form u(x — y), where u 
is a differentiable function of a single variable. 


13-3 THE CLASSICAL PARTIAL DIFFERENTIAL EQUATIONS 


Throughout the next three chapters, we shall, with but one exception, be ex- 
clusively concerned with boundary-value problems involving various forms of the 
following second-order linear partial differential equations: 


O7u 07u 07u 1 δε 

a 72 ee ae a> 0, (13-2) 
85. 07u δ. 2 OU 

4x2 ay? 302 = a ap a> 0, (13-3) 
δ΄ 07u δ 

5x2 + ay? 922 ΞΞ 0. ([3-4) 


Each of these equations first arose in classical (i.e., Newtonian) physics as the 
mathematical description of a particular type of physical system, and the first two 
are still known by the names of the simplest systems they describe. Thus (13-2) 
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is called the wave equation, and (13-3) the heat equation. Equation (13-4), on the 
other hand, is known as Laplace’s equation in honor of one of the mathematicians 
who first studied it. For the present we shall content ourselves with the observa- 
tion that Laplace’s equation can be viewed as the time independent version of the 
heat equation, and shall turn our attention to (13-2) and (13-3). 


xX 
- nN ae FIGURE 13-3 


As its name indicates, the wave equation furnishes a satisfactory mathematical 
description of certain vibrating physical systems. In particular, the so-called one- 
dimensional wave equation 

δι 1 du 
ὃχ «2 Ot? 


(13-5) 


in which a is a positive constant, is the differential equation governing the motion 
of a vibrating string of constant density. To see why this is so, consider a stretched 
elastic string of arbitrary length which is vibrating vertically in the xu-plane and 
whose position of rest lies along the x-axis (Fig. 13-3). Throughout this discussion 
we shall make the following simplifying assumptions: 


(a) The amplitude of vibration of the string is small, and each point on the 
string moves only in a vertical direction; 


(b) All frictional forces (both internal and external) may be neglected; 


(c) The mass of the string per unit length is sufficiently small in comparison 
with the tension in the string that gravitational forces may be neglected.* 


In Fig. 13-4 we have isolated a small segment of the string and have indicated 
by T and T” the forces of tension acting on its endpoints. Since the string moves 
only in the vertical direction, the horizontal components of T and 7" must cancel, 
and we have 


Tcosa = T’ cosa’ = k, (13-6) 


where k denotes the constant horizontal ten- 
sion in the string. On the other hand, the total 
force acting on this element of the string in 
the vertical direction is 7" sina’ — Tsina. 
Hence, by Newton’s second law, 


a7u 


T’ sina’ — Tsina = p Ax a2” 


(13-7) 


FIGURE 13-4 


* The question as to whether these assumptions are permissible from a physical point 
of view and do not prejudice the solution obtained is one which must be settled by the 
physicist in his laboratory. In most situations they are, in fact, physically acceptable. 
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FIGURE 13-5 


where p denotes the mass per unit length of the string, Ax the length of the seg- 
ment in question, and 07u/dt? the acceleration of the segment at an appropriate 
point between x and x + Ax. Using (13-6), this equation may be rewritten 


T'sine’ Tsina _ pAx a7u 


T’ cos a’ T cosa k 
or 


tana’ — tana = Ὁ ὦ ΤΡ 


But tana’ = du/dx evaluated at x + Ax, and tana 


Hence 


1s 
Ax | Ox 


and passing to the limit as Ax — 0, we obtain 


x+Az Ox 


δ ok 07u 
Ox? a Of? 


where a = +/k/p. 
The two-dimensional wave equation 
atu, au _ 1 ay 
0x2 ΡΥ a? 912 


du/dx evaluated at x. 


(13-8) 


arises in physics as the differential equation governing the motion of a thin flexible 
membrane of constant density which is tightly stretched and then fixed along its 
boundary, and which vibrates in the u-direction from its position of rest in the 
xy-plane. In this case the simplifying physical assumptions under which the equa- 


tion is derived are as follows: 


(a) the amplitude of vibration is small, and every point of the membrane moves 


only in the u-direction; 
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(b) all frictional and gravitational forces may be neglected ; 

(c) the tension per unit length in any direction is constant throughout the 
membrane. 

To obtain the equation of motion under these assumptions we analyze the 
forces acting on the portion of the membrane shown in Fig. 13-5. If T denotes 
tension per unit length, then the vertical components of the forces acting along 
edges 1 and 2 of the indicated portion of the membrane are T Ax sin a; and 
T Ax sin a2 for appropriate angles αι and a2. But since the amplitude of deflection 
is small, we can replace sin a, and sin ας by tan a, and tan ag, respectively.* 

Thus the total vertical force contributed by edges 1 and 2 is 


T Ax(tan αι — tan ao). 
Similarly, edges 3 and 4 contribute a vertical force 
T Ay(tan a3 — tan a4) 


for appropriate angles a3 and a4. Thus, by Newton’s second law, 
2 
T Ax(tan a, — tanag) + TAy(tana3 — tana,) = pAx Ay va > (13-9) 


where p is the mass of the membrane per unit area, and 8,812 is computed at 
some point in the region under consideration. But 


Ou Ou 
tana, = — ; tanag = -- ὦ 
OV | 2, ,y-+Ay) OY | (29,4) 
tan a he tan ΟΝ 
3. > τ΄ 3 ag = 2. 9 
Ox (Z,Y1) Ox (7+-Az,ye) 


where x; and xg lie between x and x + Ax, y,; and ye between y and y + Ay. 
Thus (13-9) may be rewritten 


i | _ ou ΕΞ Ε _ ou |-2%3. 
ΔΤ δ) αν νυ) 9) I(xa,4) Δχίδχίαν)  9Xl@4Azy] 11 at 
* Compare 
x? x 
sx = xX -- ay ae ΠΝ 
with 
tanx =x+ 2 + ἜΣ + 
7 3 15 


Their difference is of the order of magnitude of x?/2, which is small if x is near zero. 
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and passing to the limit as Ax and Ay tend to zero, we obtain 


δε, du 1 ou 
dx? ' dy? a? at? 
where a = «/T/p. 

Finally, the three-dimensional wave equation arises, among other places, in that 
branch of physics which deals with electric and magnetic fields in space. In fact, 
by using Maxwell’s equations from electromagnetic field theory it can be shown 
that each of the components of both the electric and magnetic field strengths in a 
region of space are governed by Eq. (13-2). 

Next we consider the heat equation, and show that under appropriate assump- 
tions it serves to describe the temperature distribution in material bodies as a 
function of position and time. To obtain the one-dimensional version of this 
equation we consider a slender homogeneous rod, lying along the x-axis, and 
insulated so that no heat can escape across its longitudinal surface. In addition, 
we make the simplifying assumption that the temperature in the rod is constant 
on each cross section perpendicular to the x-axis, and thus that the flow of heat 
in the rod takes place only in the x-direction. 

Now, for empirical reasons it is assumed that the quantity of heat, AH, which 
flows across any cross section of the rod is proportional to the rate of change of 
temperature u on that cross section. In other words, 


Ou 
AH = rs k > QO, (13-10) 


where the minus sign is introduced because heat flows in the direction opposite 

to the positive direction of du/dx. But it is also known that the amount of heat 

which accumulates in any portion of the rod is proportional to the product of its 

mass and the (average) time rate of change of temperature in that mass. Hence 
Ne er (13-11) 

ot 

for an appropriate positive constant c, known as the specific heat of the material 

in question. 

To obtain the heat equation we now focus our attention on the portion of the 
rod between the points x and x + Ax. If p denotes the mass of the rod per unit 
length, then by (13-11) the amount of heat accumulating in this portion of the 
rod per unit time is 
au 


AH = cp Ax ΕΥ̓ 


where du/dt is computed at some point between x and x + Ax. But by (13-10) 
the amount of heat flowing across the two faces of this portion of the rod is 


| 


Ou 
r+Az Ox 


_ ou 
Ox 


an —+| 
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and since these two expressions must be equal, we have 


i |# _ ou | _ op au 
Taking the limit as Ax — 0, we obtain 
du a du, 
Ox? ot 


where the constant cp/k has been replaced by a” to emphasize that it is positive.* 
An argument similar in almost all respects to the one just given can be used to 

show that the temperature distribution in a thin rectangular plate, insulated so that 

no heat flows across its faces, is governed by the two-dimensional heat equation 


atu, Ou 2 au. 
x2 ὃ at 


We leave this derivation as an exercise. 

Each of the physical problems described above must also be subjected to certain 
boundary and initial conditions before the future behavior of the system can be 
determined. In the case of the one-dimensional wave equation one is interested 
in finding solutions on a finite interval [0, L] under the assumption that at time 
t = 0 both u(x, 0) and u,(x, 0) are known functions of x. Physically this corre- 
sponds to finding the equation of motion for a vibrating string of length L, given 
its initial displacement and initial velocity. Furthermore, if A denotes the end 
points x = 0 and x = L, then the boundary conditions imposed on the problem 
are always chosen from among the following: 


Ι. u(A, ὃ = 0; 

2. uz(A, ὃ = 0; 

3. u(A, t) = (1/h)u,(A, ὃ, A a constant. | 
The first of these conditions simply means that the string is held fixed at the end- 
point A, while the second is known as a free-end condition. Here the string can 
move in a vertical direction at A, but is constrained to do so in such a way that it 


always remains horizontal there (see Fig. 13-6). The third condition says that 
at x = A the displacement of the string is proportional to its slope. But for small 


FIGURE 13-6 FIGURE 13-7 


* This equation is also known as the diffusion equation. 
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vibrations we know that u,(A, ἢ = tana ~ sin a, where a is the angle which the 
string makes with the horizontal at A. Thus u(A, ἢ) = (1/A) sin a, and the string 
behaves as though it were attached to the end of a spring as shown in Fig. 13-7. 
Indeed, the requirement that such a system be in equilibrium at a given displace- 
ment u(A, ἢὃὴ is T sin a = ku(A, t), where k denotes the spring constant, and 
(3) now follows by setting h = k/T. Finally, if the coupling constant ἢ is very 
small we approach the free-end condition given in (2). 

When solving the one-dimensional heat equation it is customary to start with 
a given initial temperature distribution u(x, 0) = f(x) along the conducting rod, 
and then choose the boundary conditions from among the following: 


Ι. u(A, ὃ = k, ka constant; 
2. μ,(4, ὃ = 0; 
3. μ,(4, t) = Au(A, ὃ, ha constant. 


The first of these conditions means that the end of the rod at A is maintained at 
the constant temperature k, the second that the rod is insulated at A and neither 
gains nor loses heat at that end. This time the third condition may be read as 
asserting that the rate at which heat passes through the end at A is proportional 
to the temperature at A. 


EXERCISES 
1. Derive the two-dimensional heat equation 


anu δ΄ μ 2 Ou 


Ox2 ὃν ? δι 
under the assumptions given in the text. 


2. Show that the equation governing the temperature distribution in a thin homo- 
geneous rod is 
2 
2 Ou Ou | 
— = -- bg(x, t), ὁ ἃ constant, 
a = 53 + bg(x, ἡ 
when heat is being generated in the rod (say by an electric current) at the rate g(x, ἢ 
per unit length. 

3. Suppose that the assumptions under which the equation of motion of the vibrating 
string was derived are modified to include a retarding force due to air resistance 
which is proportional to the velocity of the string. Show that the equation governing 
the motion then becomes 


4. Suppose that an external force of magnitude G(x, f) per unit length acts on a vibrating 
string. (This is the case of “forced vibrations.”) Show that the equation governing 
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the motion is 
a7u 2 O7u 


1 
= π το ἘΞ 9 ἢ), 
Ot2 ἢ Ox? τ ρ Gah 


where p is the (constant) density of the string. 


In the following exercises we sketch a method for solving the one-dimensional 
wave equation discovered by the 18th-century French mathematician and philosopher 
Jean d’Alembert and called after him d’Alembert’s solution of the wave equation. 


5. Prove that the function 
u(x, ἢ = f(x + at) + g(x — at) 
is a solution of the one-dimensional wave equation whenever f and g are twice dif- 
ferentiable functions of a single variable. 


6. (a) Let G(p, g) and its derivatives Gp, Gq, Gop, Gog, and Gq be continuous through- 
out the pq-plane. Prove that there exist twice continuously differentiable functions 
G, and 6. of a single variable such that 


G(p,q) = Gilp) + Ge@) 
if and only if G,, = 0. 
(b) Let F(x, ἢ be a solution of the one-dimensional wave equation, and suppose 
that F,., Fr, and Fy, are continuous. Set p = x + at, ᾳ = x — at, and, as in 
Exercise 3(b) of Section 13-2, rewrite F(s, ἢ in the form G(p, 4). Prove that G,, = 0, 


and then use the result in (a) to conclude that every twice continuously differentiable 
solution of the one-dimensional wave equation has the form 


f(x + at) + g(x — at). 


7. Let u(x,t) = f(x + at) + g(x — at) be any twice continuously differentiable 
solution of the one-dimensional wave equation, and note that 
u(x, 0) = f(x) + eg), 
u(x, 0) = aL f(x) — g’@)]. 
Set 
r(x) = f(x) + 50}, 
s(x) = al ΄ ΟἹ — “σ΄ ΟἹ]. 


and show that 
xtat 


u(x,t) = 5 (rx + at) + r(x — αἢ] + = | δίφ) de. 


zr—at 
(This is d’Alembert’s solution of the wave equation.) 


8. (a) Show that the physical units of the constant appearing in the equation 


aud Ou 


Ox2 a2 δι2 
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are those of velocity; ie., length/time. [Hint: Recall that a = »/T/p, where the 
units of T and p are, respectively, force/length and mass/length, and then use 
Newton’s second law. ] 


(b) Use the above result together with Exercise 6(b) to show that every twice con- 
tinuously differentiable solution of the one-dimensional wave equation can be 
interpreted as the superposition of two standing waves, one of which moves to the 
right, and one to the left, both with velocity a. 


FIGURE 13-8 


9. Suppose that at time ¢ = 0 a homogeneous string of infinite length is displaced as 
shown in Fig. 13-8 and then released from rest. Sketch the displacement of the 
string at time tf = 3, ¢ = 1, and ¢ = 2, under the assumption that a = 1. [Hint: 
See Exercise 8(b).] 


13-4 SEPARATION OF VARIABLES: 
THE ONE-DIMENSIONAL WAVE EQUATION 


In this section we introduce the method of separation of variables for solving 
boundary-value problems involving partial differential equations. In essence this 
method consists of finding solutions of the equation which are products of func- 
tions of a single variable, and then combining these solutions in such a way that 
the given boundary conditions are satisfied. To illustrate how this is done we 
consider the one-dimensional wave equation 


δ΄ μ 1 δμ 
Ae 9 (13-12) 


subject to the boundary conditions 
u(O, t) = u(r, ἢ) = 0, 
u(x, 0) = f(x), (13-13) 
u(x, 0) = g(x), 


where f and g are assumed known. Physically this problem consists of finding 
the equation of motion of an elastic string which 15 stretched along the x-axis from 
0 to z, clamped at its endpoints, given initial position f(x), initial velocity g(x), 
and then allowed to vibrate freely. 

We begin by seeking solutions of (13-12) of the form 


u(x, ἢ = X(x)T(O), (13-14) 
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where X and T are, respectively, functions of x and ¢ alone. Furthermore, we 
demand that these solutions be such that u(0,t) = u(x,t) = Ο for all t > 0 
(see 13-13). This, in turn, implies that X must satisfy the endpoint conditions 
X(0) = X(r) = 0, else (13-14) would yield T(t) = 0, and u(x, ἢ would then be 
the trivial solution of (13-12). If we now assume (as we must) that X and 7 
are twice differentiable, then 


δ μ a°u " 


a ee ge ee 


Substituting in (13-12), we obtain 


X’T = τ AT" 
a2 ° 
whence 
XxX" 1 T" 
xX ar a 


whenever XT ~ 0. At this point we make the crucial observation that the left- 
hand side of this expression is a function of x alone, while the right-hand side 
involves only ¢. Thus each is a constant, \, and (13-15) is equivalent to the pair of 
ordinary linear differential equations 


X" — »X = 0, 


(13-16) 
1’ — λα Ἱ = 0, 


the first of which must satisfy the endpoint conditions X(0) = X(m) = 0. 
To solve these equations we first note that the boundary-value problem 


X"~\»X=0, X00) = Xn = 0 


is essentially the one solved as Example 1 in Section 12-6. Thus we know that up 
to multiplicative constants the only nontrivial solutions of this problem are 


X,(x) = sinnx, n= 1,2,..., (13-17) 


corresponding to the eigenvalues \, = —n”. 


general solution of T’” — λα 1 = 0 is 


Moreover, when \ = —n?” the 


T,(t) = A, sin nat + B, cos nat, (13-18) 


where A, and B, are arbitrary constants. Hence, forming the product of the 
functions in (13-17) and (13-18), we see that each of the functions 


Un(x, t) = sin nx(A, sin nat + B, cos nat) (13-19) 


is a solution of the one-dimensional wave equation which vanishes when x = 0 
and x = π. 
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This done, we now attempt to use these functions to construct a solution u(x, ἢ 
of (13-12) such that 


u(x,0) = f(x), u(x, 9) = g(x). (13-20) 
In general, of course, no one of the u,(x, t) by itself will satisfy these conditions. 


Neither, for that matter, will any finite sum of them, and it therefore appears that 
the only possible choice is an infinite series of the form 


οΟ 


Σὺ Un(x, ἢ 


n=1 


_ u(x, ἢ 


Ι 


= Σ᾽ sin nx(A, sin nat + B, cos nat) (13-21) 
n=1 


for suitable values of A, and B,. Now when ὦ = 0, this series reduces to 


u(x,0) = >> B, sinnx, (13-22) 


n==1 


and we see that the first condition in (13-20) will be satisfied if the B, are chosen 
in such a way that (13-22) converges (pointwise) to the function f in the interval 
[0, x]. But this is a familiar problem which, as we know, can be solved in either 
of the following equivalent ways. 

I. Let O; denote the odd extension of f to the interval [—7, π] (see Section 9-5), 
and let B, be the nth Fourier coefficient of Os. Then 


| B= af f(x) sin nx dx, (13-23) 
0 


and whenever / is sufficiently well behaved, the series obtained from (13-22) 
using these values for the coefficients will converge to f everywhere in [0, z]. 

II. The functions sin nx, = 1,2,..., form a complete set of eigenfunctions 
for the Sturm-Liouville problem 


xX” — x = 0, X(0) = X(r) = 0, 


and are an orthogonal basis for the space @C[0, 7] (Theorem 12-7). Thus the 
B,, in (13-22) may also be computed as the coefficients of the expansion of f in 
terms of the eigenfunctions sinnx. The student should realize that the same series 
is obtained in either case. 

The technique for determining the A, is much the same. We differentiate (13-21) 
term-by-term with respect to ¢ (under the assumption, of course, that this can be 
done), and then set ¢ = 0. Using the fact that u;(x, 0) = g(x), we obtain 


g(x) = >) naA, sin nx, (13-24) 


n==1 
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and it follows that naA, must be the nth coefficient of the eigenfunction expansion 
of g. Thus 


5.) re 
= — -2 
An ead g(x) sin nx dx, (13-25) 
and we are done. 
An excellent picture of the physical significance of this solution can be given 
in the special case where g(x) = 0. Then 


οο 
u(x, 1) = Σ, B,, sin nx cos nat, 
n=1 


and the components of the motion assume the simple form 
Un(x, t) = B, sinnxcosnat, n= 1,2,.... 


In this case the frequency of vibration of each of the components of u is an integral 
multiple of the fundamental frequency νι = a/2n of μι. This frequency deter- 
mines what is known as the fundamental tone of the vibration, and its multiples 
determine the overtones or harmonics. 

The way in which the eigenvalues determine the frequencies of the various 
modes of vibration of the string becomes strikingly clear if the u,(x, ἢ) are graphed 
for various values of t, as in Fig. 13-9. For a rapidly moving string these figures 
present a reasonably accurate picture of the fundamental vibration and its first 
three harmonics. The reader should note that the different overtones are char- 
acterized by the appearance of nodes or stationary points which may be regarded 
as visual manifestations of the eigenvalues for this problem. In the general case 
where g ~ 0 the situation is much the same, but does not lend itself to such an 
easy graphical realization. 


τ 
i=0 t=0 jy 
i ἡ t=0 
Vass [τα 
a 
u; (x,t) | Uo (x,t) 
pace 
= 3a = ant ees 
t=0 t=0 t=0 =a t=0 = λα 
per t=0 emo 
. 3a ; 3a 
με(χ,ἢ FIGURE 13-9 ug (x,t) 


* The frequency v of the wave described by the function cos at is, by definition, a/27. 
Physically, ν may be interpreted as the number of waves which pass a given point per 
unit time. 
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EXERCISES 


In Exercises 1 through 5 find the solution u(x, ἢ) of the one-dimensional wave equation 
on the interval [0, L] subject to the endpoint conditions u(0, 4) = u(Z, 4) = 0 and initial 
conditions as given. 


1. u(x,0) = sin u(x, 0) = 0 


2. u(x,0)=0, u(x,0) = sin 


3. u(x,0) = x(L — x), u(x, 0) = 0 


0 for O< x<L/3 and 2L/3<x<L 


4. u(x, 0) = 0, ,9) = 
ee ay) " for L/3 <x < 2L/3 


N 
> ux,0) = > B, sin = 


n=l 


ATX 


N 
5. u(x,0) = > An sin = 
n=] 


6. If gravitational acceleration is taken into account the motion of a vibrating string 
is governed by the equation 


(See Exercise 4 of the preceding section.) Find the time independent solution of 
this equation, and show how to use it to treat the general case. 


7. Find the equation of motion of a vibrating string with fixed ends if it is released 
from rest in the plucked position shown in Fig. 13-10. Sketch the position of the 
string at times L/2a, L/a, 3L/2a, 2L/a. 


0 L L 0 XQ L 
FIGURE 13-10 FIGURE 13-11 


8. Generalize the results of the preceding exercise to the case where the string is plucked 
as shown in Fig. 13-11. 


9. (a) Solve the one-dimensional wave equation subject to the conditions 


u(0O, t) = u(L, ἢ) = 0, 
u(x, 0) = 0, 


0 for ὃ < |x — L/2| « L/2, 


WACO) Fe 1/(2p5) for |x — L/2| < ὃ, 


where p is the linear density of the string. 
(b) Take the limit of the solution found in (a) as ὃ — 0, and interpret the result 
physically. 
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10. (a) Show that the solution of the boundary-value problem 


μί0, 1) = u(L, ἢ = 0, 
u(x,0) = f(x), 
u(x, 0) ἘΞ g(x), 


is v(x, ὃ + w(x, ὃ, where v(x, 2) is a solution of 


2 2 
20 Uu Ou _ 
α΄ τὲ ὃ ἐν ἐ 
such that v(0, ὃ) = v(L, 4) = 0, and w(x, 2) is the solution of 


2 2 
290 u Ou 


eae ef 0” 
such that w(0,) = νά, = 0, w(x, 0) = f(x) — v(x, 0), wilx, 0) = 90) -- 
v:(x, 0). 
(b) Use the technique suggested in (a) to solve the boundary-value problem 
au - au = sin x cost 
ΟΧΣ Ot2 : 


u(0, 2) = u(L, ἢ = 0, 
u(x, 0) = f(x), 
u(x, 0) = g(x). 
11. Under suitable assumptions it can be shown that the torsional vibrations of a 


homogeneous metallic shaft of uniform circular cross section are governed by the 
partial differential equation 

812 Ox2 
where a is a positive constant, and ¢(x, 2) is the angular displacement from equi- 
librium at time t of the cross section of the shaft at x. (See Fig. 13-12.) Assume a 
shaft of length Z with g(x, 0) = f(x), ¢:(x, 0) = σοὺ. 


FIGURE 13-12 


(a) Find ¢(x, 1) if the ends of the shaft are clamped, 1.e., if ¢(0, ὃ = ¢(Z, ἢ = 0. 


(Ὁ) Find g(x, A if ¢:(0, ὃ =  φι(ί, ἢ = 0. (These conditions obtain when the 
ends of the shaft are free to twist and no torque is transmitted across them.) 


(c) Find g(x, A if the shaft is clamped at x = 0 and free at x = ἢ. 


522 THE WAVE AND HEAT EQUATIONS | CHAP. 13 


*13-5 THE WAVE EQUATION; VALIDITY OF THE SOLUTION 
In the preceding section we saw that the series 
u(x, t) = Σ sin nx(A, sin nat + B, cos nat) (13-26) 
n=] 


provides a formal solution of the boundary-value problem 


δ΄ 1 O7u ; 
0x2 a2 ot? 


u(O, t) = u(x, ἢ) = 0, 


and that the initial conditions u(x, 0) = f(x) and u;(x, 0) = g(x) can be formally 
satisfied by choosing A, and B, as the coefficients in the orthogonal series ex- 
pansions 


a nsinnx = f(x) and δ > nad, sinnx = g(x) (13-27) 


n=1 n=1 
on [0, 7]. To complete the discussion of this problem we now impose conditions 
on f and g which are sufficient to guarantee the validity of these results. Our 
choice in this respect will be guided by the various convergence theorems for 
Fourier series proved in Chapter 10, and we shall assume that the reader is familiar 


with these results. 
The first step in our argument consists of the simple observation that with A, 


and B,, as above 


u,(x, t) = ᾿Ξ B,, sin nx cos nat (13-28) 


n=!1 


is the formal solution of the boundary-value probem 


atu 1 au, 
0x2 α2 Of? 
u(O, t) = u(x, t) = 0, (13-29) 
u(x,0) = f(x), u(x, 0) = 0, 
and 
Uo(x, t) = > A,, Sin nx sin nat (13-30) 
n=1 


is the formal solution of 


dtu 1 ow, 
ax2 α2 At? 
u(0, t) = u(x, t) = (13-31) 


u(x, 0) = 0, u(x, 0) = ices 


13- | THE WAVE EQUATION; VALIDITY OF THE SOLUTION 523 


Thus (13-26) can be viewed as the sum of the solutions of two simpler problems, 
and it suffices to direct our attention to them. 

Beginning with the first, that is with (13-28) and (13-29), we recall that the 
series for f given in (13-27) will converge (pointwise) to f(x) for each x in [0, 7] 
whenever 


(i) fis continuous and f’ piecewise continuous on [0, 7], and 
(ii) fO) = f(x) = 9. 


Moreover, under these hypotheses, this series is actually uniformly convergent on 
(— οὐ, 00) where it represents the odd extension of f on [—7, 1] repeated periodi- 
cally along the entire x-axis. Denoting this extension by F, so that 


F(x) = >> B, sinnx (13-32) 
n=1 
for all x, we now use the identity 
sin nx cos nat = 4sinn(x — at) + Zsinn(x + at) 
to rewrite (13-28) as 
u,(x, t) = ἘΣ) B,, sin πίχ — at) + ἘΣ) Β,. sinn(x + αὖ. (13-33) 
n=1 n=1 


(The rearrangement of terms here is justified by the fact that under the hypotheses 
in effect this series is absolutely convergent.) Thus 


μιί(χ, ἢ = [δὰ — at) + F(x + at)], 
and it now follows that 


u,(0, t) = 3[F(—at) + F(at)] 
= $[—F(at) + F(at)] 
= 0, 

u(r, ἢ) = 4[F(x — at) + F(x + αἱ] 
= $[F(—a — at) + Fr + at)] 
= ${—F(r + at) + Fr + at)] 
= 0, 


and 
μι(χ, 0) = 3[F(x) + FO)] 


on [0, π]. Thus wu, satisfies the first three boundary conditions. 
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To ensure that it satisfies the last as well, we now demand that 
(11) f’ be continuous on [0, z].* 


Under this assumption it is easy to show that F’ exists and is continuous for all x 
(see Exercise 3), whence ἡ 


an = 4—aF(x — at) + aF(x + at) 
and 
Our) = _aF (x) + aF(x)| = 0, 
Ot |t—0 


85 required. 
Finally, to complete the argument and prove that u, is also a solution of the one- 
dimensional wave equation we impose the following additional restrictions on /: 


(iv) f” is continuous on [0, 7], and 
(v) υ΄Ὁ) = f(x) = 0. 


For then, arguing as above (Exercise 3 again) we find that F’’ is everywhere con- 
tinuous, and that 


2 2 
je - ΣΙΡῸ -- at) + Fx + at) 
07u, wow Ε΄ 

ὃχ [δ  α -- at) + (x + αἢ)]. 


Thus 
=e 07uy 


0°uy 1 
δΧΣ α2 812 


9 


and the proof is completé. 
This done, we turn our attention to the formal solution uz of the boundary- 


value problem described in (13-31), and begin by assuming that 
(i) g is continuous and g’ piecewise continuous on [0, 7], and 
(ii) g(0) = g(x) = 0. 


Under these conditions we know that the Fourier sine series 


g(x) = > C,, sin nx 
n=1 


* In particular, this means that f has a right-hand derivative fp at zero, a left-hand de- 
rivative 1, at π, and that 


lim f(x) = fr), lim f(x) = fix). 


x Ot 
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converges uniformly and absolutely to g(x) for all x in [0, r]. Since A, = C,,/na, 
we have 
Uo(x, 1) = : 3 Cn sin nx sin nat (13-34) 
2\5 a cer n : 


Thus if we tentatively allow the necessary term-by-term differentiation, we find that 


Ou2 = : 
Ὁ ΤῊ Ξ Σ᾽ C,, sin nx cos nat 


n=l 


or, using the trigonometric identity introduced earlier in this section, 


oo = poe n Sin n(x — at) + ἫΝ C, sin n(x + at). (13-35) 


n=1 


But the assumptions imposed on g imply that these two series are uniformly and 
absolutely convergent on [0, x]. Hence so too are 
“ : lad . 
Σ, C,, sin nx cos nat and -- >. — sin nx sin nat, 
a n 

n=1 n=1 
and the term-by-term differentiation of (13-34) is therefore legitimate. Moreover, 
if G denotes the odd periodic extension of g to the whole real line, then 


0 
| 2 = HG(x — at) + G(x + aty) 
and 
t t 
u(x,t) = ἃ [ G(x -- at)dt + 4 [ G(x + at) dt, 
0 0 
or 
1 x+at 
Uo(x, t) = AG : G(s) ds. (13-36) 
aJ/z—at 
From this it follows at once that u2(x, 0) = 0 and that 
Ou2) 
or t=0 — g(x) 


on [0, x]. Thus the function defined by (13-36) satisfies the initial conditions 
prescribed in (13-31). Furthermore, since G is odd and periodic with period 27, 
it satisfies the end conditions u.(0, f) = μοί(π, ἢ = Ο as well. Hence, to com- 
plete the argument we need only show that this function is also a solution of the 
one-dimensional wave equation, and that its series expansion is 

ἐδ τς 


n=1 


sin nx sin nat, 


Qi 
=|P 


as required by (13-34). 
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To this end we recall that 


ua 
Ot 


3[G(x — at) - σία + ar)] 


oo 
Σ, C,, sin nx cos nat, 


N=l 


and that this series converges uniformly and absolutely to 
31G(x — at) + G(x + at)] 


on [0, +]. Hence we can integrate term-by-term to obtain 


zt+at 


μοίχ, t) = — G(s) ds 


οΌ 
Ce 
> τ, Sin nx sin nat, 


as required. In addition, this series can be differentiated term-by-term with 
respect to either variable, from which it follows that 


ee = se [G(x + at) — σὰ — at], 
2 = G(x + at) + Gx — at} 


Finally, to assure the existence of the second partials of μὸ we now assume that 
(11) g’ is continuous on [0, π]. 


This implies that G’ exists and is continuous on (— οὐ, oo), and that 


839 ΜΕ Ϊ ee / =e 
a3 = 5, [6 (x + at) — G(x — at)], 
δ᾽.) “σα + at) -- G(x -- at). 
Or? 2 


Thus 


and we are done. 
When taken together these two arguments furnish a proof of the following 


theorem. 
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Theorem 13-1. Zhe series 


u(x, t) = > sin nx(A,, sin nat + B, cos nat) 


n=1 


with 


κ 


2 : 
A. = ee g(x) sin nx dx, 


B, = Ξ | f(x) sin nx dx, 
πο 


converges uniformly and absolutely to a solution of the boundary-value 


problem 
au 1 ou, 
ΟΘΧΣ α δι12 
μίθ, 1) = u(x, 1) = 0, 
u(x, 0) = SOX), ur(x, 0) = g(x), 
whenever 


(1) f, f’ and f” are continuous on [0, x] with 


ΓΟ) = f"O) = fx) = f") = 9, 


and 


(2) g and g’ are continuous on [0, 1] with 


g(0) = g(r) = 0. 


Although Theorem 13-1 is sufficient for most purposes, it is clearly not strong 
enough to handle every boundary-value problem involving the one-dimensional 
wave equation that arises in practice. Perhaps the best known example which 
falls outside the scope of this theorem is that of the “‘plucked string,” and involves 
finding the equation of motion of a string which is released from rest in the position 
shown in Fig. 13-13. Here too a formal solution can be obtained by the method 
of separation of variables (see Exercise 8, Section 13-4), but a much more careful 
analysis than the one given above is required to treat those points where f’ and 
f” have discontinuities. We shall omit this 


discussion since it would carry us further 
afield than we care to go, and content our- | | 
selves with the remark that in most cases the x 


formal solution can in fact be proved valid.* " ἄχ; =. 
FIGURE 13-13 


* For instance, see Chapter 4 of H. Sagan, Boundary and Eigenvalue Problems in 
Mathematical Physics, John Wiley & Sons, Inc., New York, 1961. 
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EXERCISES 


1. Give a rigorous discussion modeled on the one appearing above to establish the 
validity of the formal solution of the boundary-value problem 
0x2 Or? 
μί0, t) = 0, u,(r, t) = 0 
when 
(a) u(x, 0) = f(x), u(x, 0) = 0; (Ὁ) u(x, 0) = 0, u(x, 0) = g(x). 
(Physically this is the problem of a torsionally vibrating bar with one fixed end and 
one free end. See Exercise 11, Section 13-4.) 


2. Repeat Exercise 1 for 


when 
(a) u(x, 0) = f(x), u(x, 0) = 9; (Ὁ) u(x, 0) = 0, u(x, 0) = g(X). 
(Physically this is the problem of a torsionally vibrating bar with both ends free.) 


3. Let f be continuously differentiable on the interval [0, a), and suppose that 
lim f(x) = 4100), 
z>0t 
where f,(0) denotes the right-hand derivative of fat zero; i.e., 


#80) < tim L0>- LO. 
hot h 

Assume that f(0+) = f(0) = 0. 
(a) Prove that O,;, the odd extension of f to (—a, a) is continuously differentiable on 
(—a, a). 
(Ὁ) Show that Οἱ need not have a continuous derivative at x = 0 even when f” is 
continuous on [0, a) and fp (0) exists. [Hint: Consider the function x + x?.] 
(c) Prove that O; is continuous on (—a, a) whenever f is twice continuously dif- 
ferentiable on [0, a) and f; (0) = 0. 


13-6 THE ONE-DIMENSIONAL HEAT EQUATION 


In this section we shall use the method of separation of variables to solve boundary- 
value problems involving the one-dimensional heat equation 


Oru _ 2 OU, 


Ax2 = a δι (13-37) 
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As our first example we consider (13-37) in conjunction with the boundary 
conditions 


u(O, ὃ) = 0, 
u,(L, t) = —hu(L, ἢ, ha constant, (13-38) 
u(x,0) = f(x). | 


Physically these equations describe a slender insulated rod of length L, with initial 
temperature distribution f(x), whose left-hand end is kept at 0°, and which loses 
(or gains) heat through its right end at a rate proportional to the temperature at 
that end. The problem is to find the temperature u(x, ἢ) in the rod as a function 
of position and time. 

We begin by seeking solutions of (13-37) of the form 


u(x, ὃ = X(x)T(1) (13-39) 


in which X is twice differentiable, T once differentiable, and each is a function of 
a single variable. In addition we demand that these solutions satisfy the given 
boundary conditions u(0, t) = 0, u,(L, ἢ = —Au(L, ἢ). Substituting (13-39) into 
(13-37) and dividing by XT we obtain 

ΧΙ 2 LT? 


χ᾿ 


whenever XT =~ 0, and it follows that 


X” — »X = 0, 
(13-40) 
PST =i, 
Qa 


λ a constant. Moreover, it is easy to see that the only way in which XT can be 
nontrivial and yet satisfy the required boundary conditions is for X itself to satisfy 
those conditions. Hence we must begin by solving the Sturm-Liouville system 


X" — rX = 0; 
X(0) = 0, 
AX(L) + X'(L) = 0. 
But this problem has already been discussed in Section 12-6, and we know that 
its eigenfunctions are 
X,(x) = sind,x, n= 1,2,..., 
where X, belongs to the eigenvalue —)? obtained by solving a certain transcen- 


dental equation (see Eq. 12-27). Furthermore, for each of these values of ἃ the 
general solution of T’ + (\2/a”)T = Ois 


2, 2 
T,(t) = A,e 7 On!@ ye 
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Hence the only nontrivial solutions of (13-37) which are of the form XT and 
which satisfy the first two boundary conditions in (13-38) are 


un(x, ἢ = Ay sin yx)eO"?*, n= 1,2,..., (13-41) 


A,, an arbitrary constant. 

It now remains to use these functions to construct a solution u(x, 2) of (13-37) 
which also satisfies the boundary condition u(x, 0) = f(x). To this end we form 
the series 


99 2, 2 
u(x,t) = >) 4,.6 515} sin (Anx) 
n=1 


and set ¢ = 0 to obtain 


u(x, 0) = > Ay SiN ApX. 


n=1 


From this it follows that the A, must be chosen as the coefficients of the series 
expansion of fin terms of the eigenfunctions sin \,x.* Thus 


Ay = 2 L(x) sin On) de, 
: Jy sin? (Apx) dx 


and the series 


a0 L . 
μα, Ὁ = δ᾽ 15.100 sin μὴ δα ates 


sin (Ap), (13-42) 
a= So sin? (nx) dx 


which converges in the mean in @C[0, L], is a formal solution of the given problem. 
As our second example we solve the one-dimensional heat equation given that 
u(0O, t) = 100, 
uz(L, t) = —hu(L, ἢ, haconstant, (13-43) 
u(x, 0) = f(x). | 


Here the first boundary condition is nonhomogeneous, and we must therefore 
begin ty finding a particular solution u(x, ἢ) = X(x)T() of (13-37) such that 
u(0O, ὃ) = 100, u,(L, 1) = —hu(L, t). As before, X and T will then be solutions of 


ΧΡ — X= 0, 
T'-~T=0, 
a 


* The reader should note that there is no possibility of using a Fourier series here. 
The expansion must be given in terms of the sin λ,χ. 
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and by setting \ = 0 in these equations we immediately obtain XT = Ax + B, Aand 
Bconstants. The boundary conditions in effect imply that A = —1004/(1 + AL), 
B = 100, and it follows that 


100h 


Uo(x, t) = Kx + 100, K = ~ T+ AL 


is a solution with the desired properties. 

This done, we now observe that the sum of uo and any solution of (13-37) which 
satisfies the homogeneous boundary conditions u(0, ἢ) = 0, u,(L, ἢ) = —Au(L, ἡ 
will in turn satisfy the first two boundary conditions in (13-43). In particular, our 
earlier results imply that 


u(x, t) = (Kx + 100) + D> Anew #2 sin (Xnx) (13-44) 


n=1 


is such a solution, and the problem will be solved as soon as the A, are chosen so 
that u(x,0) = f(x). But when t = 0, (13-44) becomes 


u(x, 0) = (Kx + 100) + >) An sin Anx. 


n=1 
Thus 
ΓΞ So Lf@) -- Kx — 100] sin (nx) dx. 
" SF sin? (A,x) dx 
and we are done. 
In Section 13-9 we shall prove that these series are solutions of the boundary- 


value problems in question whenever f and f’ are piecewise continuous on [0, L], 
and f(x) = 3[f(x*) + f(x~)] everywhere in the interval. (See Theorem 13-3.) 


EXERCISES 


In each of the following exercises find the solution u(x, ἢ) of the one-dimensional heat 
equation which satisfies the given boundary conditions. 


x, 0<x<L/2 
1. μί0, ἢ) = u(Z, ἢ = 0; u(x, 0) = 
L—x, L/2<x<L 
2. μί0, 2) = u(L, t) = 0; u(x, 0) = k sin = k a constant 
3. u(0, ὃ) = u(LZ, ἢ = 0; u(x, 0) = x(L — x) 
4. uO, 1) = u(Z, ἢ = 0; u(x, 0) = f(x) 
5 WX 


. u,(0, tf) = u,(L, t) = 0; u(x,0) = ksin TT’ k a constant 
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10. 
11. 


12. 


13. 


14. 
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6. uz 0, 1) = u(L, 1) = 0; u(x, 0) = x(L — x?) 
7. 
8 
9 


uz 0,0) = ux(L, ἢ = 0; u(x, 0) = fx) 


. Μ(), ἢ = u(L, ἢ = 0; u(x, 0) = f(x) 
. uO, t) = 100, u(L, 1) = 0; u(x, 0) = 100 cos 5 


u,0,t) = u,(L,t) = k, kaconstant; u(x,0)=0 

The temperature in a slender insulated rod of length L satisfies the endpoint con- 
ditions u(0, ἢ) = 0, u(L, 2) = 1, and initial condition u(x, 0) = sin rx/L. 

(a) Find the temperature in the rod as a function of position and time. 

(Ὁ; What is the steady-state temperature in the rod (i.e., the temperature as t — 0)? 


Find the steady-state temperature in a slender insulated rod of length Z given that 
u(0, 2) = ko, u(L, t) = Κι, ko and ky constants, 
u(x, 0) = f(x). 


(See Exercise 110.) 


Su rpose that the temperature in the rod described in Exercise 12 is allowed to 
reach equilibrium and that the temperature at the endpoints 0 and L is then suddenly 
changed to 0 and 100, respectively. Find the new temperature distribution in the 
rod as a function of x and 1. 


The equation governing the temperature distribution in a slender insulated rod in 
which heat is being generated at a constant rate per unit length is 


k a constant. (See Exercise 2, Section 13-3.) Solve this equation given that 


uO, 7) = ul, = 0; ux, 0) = f(x). 


13-7 THE TWO-DIMENSIONAL HEAT EQUATION; 


In this section we shall study the flow 
of heat in a thin rectangular plate R of 
length 1, and width M, situated in the xy- 
plane as shown in Fig. 13-14. Under the 
assumption that heat is neither gained 
nor lost across the faces of the plate, the 
flow is two-dimensional, and is described 
by the equation 


BIORTHOGONAL SERIES 


a2 2 
eee ages 30545) 


- = a 
x2 Oy? ot FIGURE 13-14 
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We now propose to solve this equation in the presence of the following boundary 
conditions: 


u(x, 0, ἢ = 0, the temperature on the 
| horizontal sides of the (13-46) 
u(x, M, ὃ = 0; plate is held at 0; 
u,(0, y, t) = 0, the vertical sides are 
| insulated and no heat (13-47) 
u,(L, y, ἢ = 0; flows across them; 


u(x, y,0) = f(x, y); the initial temperature 


distribution is known. (13-48) 


As usual we seek product solutions of the form 


u(x, γ, ἢ = X(X)YO)TM 


which are nonzero in the region under consideration. Substituting this expression 
in (13-45) and dividing by X YT, we obtain 


xX" y” 7 9 ΤΊ 
= ees cee - (13-49) 


Thus 


A, Aaconstant, 


and we have 
Υ' -- ΧΥ͂ = 0. 


The boundary conditions (13-46) imply that Y(0) = Y(M) = 0, and lead to the 
familiar set of eigenvalues —n?r?/M7, and eigenfunctions 


μπν 


Υ̓, Ὁ) = 4, sin μ᾿ t= | a eee (13-50) 
Next we substitute these eigenvalues in (13-49), obtaining 
Χ’' 2Τ' i 
χ 417 MP’ (13-51) 


from which it follows that X’/X is also a constant, wy. Taking (13-47) into con- 
sideration we find that we must now solve the Sturm-Liouville system 


χ' —pX=0; X'(0) = XL) = 0. 


Leaving the details to the reader, we assert that in this case the eigenvalues are 


2 2. 2 
ἘΠ ΞΡ, ΡΝ Ἐπ (Ὁ 
Ho Ξ ιν, μι = 12 Mm ~ “ΓΤ 


§ © #8 @ 9 
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and that the eigenfunctions belonging to the μρμι are 


INWTX 
L 


Xm(x) = By cos > m= 0,1,2,... (13-52) 


For these values of X, (13-51) becomes 


and. 
2 2 2 
T -- οἷ (1|α) Uni by +n ja) je (13-53) 


(The constant of integration may be omitted without prejudice at this point.) 
We now combine (13-50), (13-52), and (13-53) to conclude that each of the 
functions 


NTX ; nr a 2 2 2 
An COs Ga sin Gr) e (x/a) ((m/L)'+(n/M)"]t, 


m=0,1,2,..., m= 1,2,..., Amn arbitrary, 


Umn(X, γ, ἢ (13-54) 


is a solu tion of the two-dimensional heat equation which also satisfies the boundary 
conditions given in (13-46) and (13-47). 

To complete the solution of the given problem we must now choose the Amz 
so that the (double) series 


u(x, γ, 1) = Σ᾽ Umn(% y; ἢ 


m=0 
n=1 


satisfies the boundary condition u(x, y,0) = f(x, y). This means that the Amn 
must be: chosen so that 


Χ. ἢ 
Λα, ») = ΣΣ Ann cos ὅπ sin παν, 
m=0 
n=l 


and hence must be the coefficients of the double Fourier series expansion of f 
in the rectangular region R under consideration (see Section 9-8). Thus 


Aon = [ 76. y) sin ("22 2) aay 
and, whenm = 0, 


Μ 1, 
_ 4 mrx\ . {ny 
A = im [ [ F(x, y) cos (7 ) sin (Ὁ se dx dy, 


and u(x, y, t) has been completely determined. 
In this case we shall omit the argument needed to establish the validity of these 
computations. Suffice it to say that u(x, y, ἢ) as determined above will in fact be 
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a solution of the given problem whenever the function f is “sufficiently’’ smooth 
in R. Moreover, it can also be shown that this problem admits only one solution, 
and hence our discussion is complete. 

This example is but one of an almost endless number of three-dimensional 
boundary-value problems encountered in mathematical physics.* In this case 
the solution was expressed as a double Fourier series, but from our earlier experi- 
ence it is clear that one can describe physically meaningful boundary conditions 
which lead to Sturm-Liouville systems with eigenfunctions other than the sine and 
cosine functions encountered here. (This would have happened, for instance, 
had we imposed the boundary conditions 


on the vertical edges of the plate.) Such sets of eigenfunctions lead to the notions 
of biorthogonal sets of functions and biorthogonal series expansions. The basic 
theorem concerning biorthogonal sets in rectangular regions was given in Section 
9-8, where it was shown that whenever {/,,} and {g,} are orthogonal bases in 
@C[a, δ] and @C{c, d], respectively, {fingn} is a (bi)orthogonal basis in @C(R), R 
the rectanglea < x < b,c < y < d. Theimport of this theorem is now obvious: 
it allows us to apply the theory of eigenfunction expansions in rectangular regions, 
and use them to solve three-dimensional boundary-value problems such as the 
one discussed above. 


EXERCISES 


1. Verify that the eigenvalues and eigenfunctions for the Sturm-Liouville problem 
ΧΙ — pX = 0, X'(0) = ΧΩ = 0 

are as given in the text. 
2. Solve the boundary-value problem discussed above when f(x, y) = sin? ry/M. 
3. Repeat Exercise 2 with f(x, y) = y(M — y)cos7x/L. 
4. Solve the two-dimensional heat equation in the rectangular region 0 < x < 7, 

0 < y < 7m given that 

u(0O, y, ἢ) = u(r, y, ἢ = u(x, 0,9) = u(x, 7,1) = 0, 
u(x, y,0) = f(x, y). 


5. (a) Solve the partial differential equation 


* The three-dimensional region in question is the semi-infinite slab 0 < x < L, 
0O< y< M0 <t. 
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in the region 0 < x < 7,0 < y < 2,0 < z < mw under the boundary conditions 
u(x, y,0) = f(x, y), u = 0 on all the other sides of the region. 

(b) Generalize the result in (a) to the case where u assumes arbitrary boundary 
values on all six sides of the region. 


6. Solve the boundary-value problem 


δ΄ 2 δ΄ θ΄ 
— ΞΞΩ͂ ee + eos ΑΝ ; 
Or2 0x2 Oy2 


u(0, y, t) = ula, y, t) = 0, 
u(x, 0, 1) = u(x, 7, 1) = 0, 
u(x, y,0) = f(x, y), ux, y, 0) = 0. 


7. Solve the boundary-value problem in Exercise 6 when the last boundary condition 
is replaced by u(x, y,0) = g(x, y). 


*13-8 THE SCHRODINGER WAVE EQUATION 


The second-order partial differential equation 


2 2 2 

“s τα oY γα, », 20 = KS. (13-55) 
k a constant, is encountered in quantum mechanics as the Schrodinger wave 
equation for a single particle. Its eigenfunctions are among the most interesting 
in applied mathematics, and their study has stimulated a great deal of modern 
research in this field. Unfortunately most of these results are beyond the scope of 
this book, and any attempt to solve (13-55) as it stands would be quite out 
of place here. Instead we shall limit ourselves to the one-dimensional version of 
this equation where V(x, y, z) = c?x?, c a positive constant. Artificial as these 
restrictions may seem, the problem is actually of considerable physical interest. 

Thus we consider the simplified equation 


2 
ay ως εἶχψ = oy 9 (13-56) 


which we propose to solve in the region --οο <x < 0,1 > Q, subject to the 
restriction that the solutions tend to zero as |x| — oo. Applying the method of 
separation of variables with y(x, ἢ) = ¥(x)¢(4), we find that » and y satisfy the 
equations 


dp . 
a Ee = 0, (13-57) 
and 
2 
GY + ay — c2x)yp = 0, (13-58) 


dx? 


+ For a discussion of the physical significance of (13-55) and the problem we are 
about to consider, the reader is referred to any standard text on quantum mechanics. 
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λ a constant, the second of which is subject to the “boundary” condition 
¥(x) — 0 as |x| > o. (This equation is known as the amplitude equation for the 
particle.) 

The very fact that we are now dealing with functions on (— οὐ, o) suggests that 
we attempt to solve this problem by using the Hermite polynomials H,,(x) defined 
in Section 11-6. With this in mind we recall that for each non-negative integer n 
the function e~*/*H,,(x) is a solution of the differential equation 


yo + pel ες acg (13-59) 
2 4 
(see Exercise 12, Section 11-6). The strong similarity between this equation and 
(13-58) leads us to seek a solution of the latter in the form 
S(x) = ε Ὁ ΔΉ, (ax) (13-60) 
for a suitable constant a. Differentiating (13-60) we obtain 


S'(x) = eae ‘TaH! (ax) — 4a°xH,,(ax)], 
" 2 =a" x 2),4 ” , Ϊ αχ' 
S'(x) = ave HAYy(ax) — (ax)H7(ax) — 5 Ι -- ἥτε Η, (αχ)]}- 


But since H,, is a solution of 


/? 


» — xy + ny = 0, 


we have 


Hy(ax) — (ax)H} (ax) + nH,(ax) = 0 


and it follows that 


aan eee 
this s+? 


Sx) + a? (x ἜΣ 2) S(x) = 0, 


Thus 


and we conclude that S(x) will be a solution of (13-58) if a = (4c”)!/* = /2c. 
This, in turn, implies that the eigenvalues and eigenfunctions for the problem 
under consideration are 


An = Qn4+ Dc, n= 0,1,2,..., (13-61) 
and 


nlx) = σ᾿ ΦΎΣΗ, (26 x). (13-62) 
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(It can be shown that up to multiplicative constants these are the only eigen- 
functions for this problem.) Moreover, with ἃ, as above, 


on(t) == genes 
and we therefore conclude that the functions 


2 — 
Yn(x, t) = 4,6 ! A (2. xe ent pee, 


n = 0,1,2,..., A, arbitrary, are solutions of (13-56). Finally, as with all of 
the other problems discussed in this chapter, these functions can be used to con- 
struct series solutions of (13-56) which satisfy initial conditions of the type 
¥(x, 0) = f(x) provided f is a reasonably well behaved function. We leave the 
details to the reader. 


*13-9 THE HEAT EQUATION; VALIDITY OF THE SOLUTION 


In order to establish the validity of the formal computations in Section 13-6 
we must introduce the notion of a uniformly bounded, monotonic nonincreasing 
sequence of functions {F,,(4} on an interval J. The relevant definitions are as 
follows: {G,,(t)} is said to be 

(i) monotonic nonincreasing if G,(t) > Gn+1(t) for all ¢ in J and all n; 

(ii) uniformly bounded if there exists a real number M such that |G,()| < M 
for all fin Zand all n. (The word “‘uniform”’ is used here because M simultaneously 
bounds all of the Gy.) 

Perhaps the simplest nontrivial example of a sequence with these properties is 
ΠῚ, n = 1,2,..., on the unit interval [0,1]. In this case monotonicity is 
obvious, and uniform boundedness follows from the inequality |t”| < 1 whenever 
|‘) < 1. This last inequality actually shows that {{ὖ} is uniformly bounded on 
the larger interval [—1, 1], though it is no longer monotonic there since the 7” 
alternate in sign to the left of the origin. For our purposes a more pertinent 
example is furnished -by the sequence with 


2,2 
Galt) =e OW, 


A» as in Section 13-6. Indeed, since \1 < \2 «τ, Ga) = σι. (ἢ for all 
t > 0, and {G,(#)} is monotonic nonincreasing. In addition, |G,()| < e° = 1 
for all t > 0, and hence the sequence is uniformly bounded on the semi-infinite 
interval [0, oo). , 

With this terminology in force, we now prov 


Theorem 13-2. Let ρος F,(x) be a uniformly convergent series of con- 
tinuous functions on the interval a < x < b, and let {G,(t)} be a uniformly 
bounded monotonic nonincreasing sequence of continuous functions on 
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c <t<.d. Then the series 
DY Fa(x)Ga(2) (13-63) 
n=l 


is uniformly convergent in the rectanglea <x < be <tK<d. 


Proof. The proof is based upon the fact that an infinite series is uniformly con- 


vergent if and only if its associated sequence of partial sums is uniformly a Cauchy 
sequence (see Appendix I). Thus if 


k 
sex, ἢ = >> Fa(x)Galt) 
n=1 


denotes the kth partial sum of (13-63), we will be done if we can show that for each 
€ > 0 there exists an integer K such that whenever k > K, p > 0, 


Iseap(x, Ὁ — s(x, ἢ] < € (13-64) 


for all x and ¢ in the prescribed rectangle. 
To this end let 


k 
o1(X) an >; F, (x) 
nN=1 
be the Ath partial sum of the uniformly convergent series Σ =1 F,(x). Then 
F(x) = o;(x) — σχ. τ(Χ) for all k > 1, and we have 
Sktp — δὲ = FripGrap + τ. + κι 
= (Ckip — Tk4p—1)Grtp + °°° 
Ἔ (σκ..2 ἘΞ Tr41)Ge+2 ἘΝ (σκᾳι = On )Ge41 


[(σκᾳ» ire σι) -- (σμ.»..1 -- Tr )IGusp + eee 
+ [42 — σι) — (σκιεν — σι]. ι2 + (σκαει — OK)GE41 


P p—l 
> (Crtn — Ox)Gein — > (kin — Ox)Geon+1 


n=l n=1 

p—l * 
= >, (Chan — TkMGeon — Gryn+i) + Okip — Tk)Gr+p- 

n==1 


* This result is a modified form of the ‘“‘ssummation by parts’’ identity 


k+1 k 
4%410%41 - ayb, = » an(bn - bn—1) + »" ῥδι(α, 1 = An), 
n=2 =] 


so called because of its similarity with the formula for integration by parts. 
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Thus 
p—l 
Sepp — Sel < δ) loean — Fel (Gepn — Grtngal + ἰσιε» — xl |Gerol- 
ὡς (13--65) 


Now let € > 0 be given, and ἰεΐ M be such that |G,()| < ™ for all x and all t 
in the interval [c,d]. Then since Στ F,(x) 1s uniformly convergent on [a, δ] 
we can find an integer K such that 


ε 
\itn — σι < 3M 


for all k > K,n > 0, and all x in [a, δ]. Substituting this inequality in (13-65) 
we obtain 


p—l 
Sktp — δεῖ < 1p IGitn — Grtn4il + Gre] (13-66) 
. n=] 
But since {G,,(4)} is monotonic nonincreasing, Ομ. (ἢ > Grin4i(d for all ἐ, and 


p—l p—l 
y Gain = Grin4il = ys (Gin ie Grint+i) 


n=1 n=1 
= (Ομ: — Gere) + (Geto -- Ges) Ὁ τ᾿ 
+ (Gr4p—1 = Gitp) 
= Gut _ σι». 


Hence 


p—1 
> IGron — Grins ΞΕ IGitpl < 2M ΞΕ M = 3M, 


n=l1 
and (13-66) becomes 
€ 
Skip τ΄ Spl < 377 (5) = ε, 


which is precisely what had to be shown. ἢ 


With this result in hand we are ready to investigate the formal solution 


u(x, ἢ) = Σ᾽ Ay sin (Anxye7 Ol (13-67) 


n=1 


of the boundary-value problem 


u(0,t) = 0, τι, ἢ) = —hAu(L,t), t > 9, (13-68) 
u(x,0) = f(x), O< x «1, 
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where the A, are determined from the orthogonal series expansion 
f(x) = Σ᾽ An Sit Anx. (13-69) 
n=1 


In this case the restrictions needed to guarantee the validity of (13-67) are 
(i) f and f’ piecewise continuous on [0, L] and 
Gi) f() = ἐὺ Ὁ + fx )] for all x in (0, 1), 


and we now assume that they are in force. The first step in the proof consists of 
an argument to show that (13-67) is uniformly and absolutely convergent in the 
region 0 < x < L,t> 0. We use the Weierstrass M-test (Appendix I), as 
follows. 

From the general theory of Sturm-Liouville series we know that (13-69) con- 
verges (pointwise) to f(x) for all x in (0, 1). Moreover, by Theorem 8-3 the series 


οὐ 


2, |Anl” 


n=1 


is convergent. Hence the sequence {|A,j|} is bounded, and there exists a positive 
constant K such that 

4,1 < Καὶ 
for all nm. From this it follows that for any tg > 0 


2, 2 2, 2 
|An sin (λ, χ)ο on!4 to < Ke ale to 


and the M-test will apply as soon as we have shown that 
9 Ke7Onlayt0 (13-70) 
n=1 


converges. To this end we note that 


enti! )to 


- ρ΄ (t0/ 4) Anti —A>n) Ont brn) 
—(r2/a7)t ; 
e n 0 


But from the way in which the Δ, were determined in the preceding chapter it is 
clear that \,41 — A, tends to a positive constant value as 2 — o. Hence 


o—Anti 1/4”) to 
lim ter tae eas ταν 0, 
no e Ania eg 


and the ratio test implies that (13-70) converges. 
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We now differentiate (13-67) termwise with respect to ¢ to obtain 


SH = ΟΣ D> AGN sin (gue OHO, (13-71) 
n=1 


and repeat the above argument using the inequality 
I . _y7 4? K Se. 
— aa Andn sin (Anx)en/? 0] < = ea 


to deduce that (13-71) is uniformly and absolutely convergent in the region 
0 <x < L,t > ty > 0. The same can also be said for the series 


a°u = 2-: —(r2 /a?)t 
73 Ξ “ Dy Andn Sin (nx)e* (13-72) 


n=1 


obtained by differentiating (13-67) twice with respect to x. Finally, (13-71) and 
(13-72) imply that 


and we have therefore proved that under the hypotheses imposed above the 
function 


= 2, 2 
u(x, t) = 2 A, sin (pxje7On!* 


n=1 


is a solution of the one-dimensional heat equation in the region 0 < x < L, 
t > 0.* 

This brings us to the boundary conditions, the first two of which can be dis- 
patched with ease, as follows. By the argument just given (13-67) is uniformly 
convergent in every (closed) region of the form t > tp > 0,0 < x < 1, and 
hence represents a continuous function there (Theorem I-21, Appendix I). But 
when x = 0, (13-67) reduces to zero, and it follows that 


u(0, t) = 0 


for allt > 0. Moreover, since 


n=1 


* At this point the reader would do well to recall the remarks made in Section 13-2 
concerning solutions of boundary-value problems, and, in particular, that they need not 
satisfy the differential equation on the boundary of the region in question. 
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forO< x<L,t2>to > QJ, 


x 2, 2 
ux(L, ἢ) = Σ) An[An COS (AnL)Je~Or!? 


n=1 
and 
90 2 
—hu(L, t) = Σ᾽ An{—hsin (gLyJeWO"! 
n=1 
But 


Asin (AnL) + ἃ, cos (A,L) = 0 


for all m (see Eq. 12-27), whence 
u,(L, t) = —hu(L, ἢ 


for all ¢ > 0, as required. 
This brings us to the boundary condition 


u(x, 0) = f(x) 


and the only troublesome step in the proof. At first sight it might seem that we 
need only set ¢ = 0 in (13-67) and watch the series reduce to (13-69) to complete 
the argument. Unfortunately this will not do. The error in such a naive argu- 
ment arises from the fact that we are not in a position to assert the continuity of 
u(x, t) for ¢ > 0, and thus cannot guarantee that u(x, 2) approaches f(x) as 
(xo, ἢ approaches (xo, 0). To establish this fact we use Theorem 13-2, as follows. 
The sequence 
fe Onley 


is monotonic nonincreasing and uniformly bounded on [0, 00). Moreover, for 
each Xo in (0, L) 


> An SIN (AnXo) 
n=1 


is a convergent series of constants, and hence is uniformly convergent. We now 
apply Theorem 13-2 to deduce that 


= 2,2 
u(Xo, 1) = >» An, SiN (AnXo)e7 Oo! 9! 
n=1 


is uniformly convergent for all ἡ > 0, and thus is a continuous function of 1. It 
now follows that | 


itm, u(Xo, t) = Σ» A, Sin (λ,Χο) = 7), 


n=1 


and we have proved the following theorem. 
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Theorem 13-3. The series 


u(x, t) = > A, sin (px eT onlane 
n=1 
with 


An, 
J = sin? (Anx) dx 


converges uniformly and absolutely in every region of the form0 < x < L, 
t > to > 0, and is a solution of the boundary-value problem 


au _ du, 
0x2 δι 
u(0,t) = 0, u,(L,t) = —hu(Z, ἢ, 12 9, 


u(x,0) = f(x), O< x <L, 
whenever f and f' are piecewise continuous and 


-+- -- 
fa) = LEAL? 


everywhere in [0, L]. 


Remark. The reader should appreciate that under the hypotheses imposed here 
this theorem is valid on/y if the last boundary condition is interpreted to mean 


lim, u(xo, ἢ) = fo) 
i—0 


for all xo in (0, 1). However, when f is continuous on [0, 1] and f (0) = f(D), 
the series 


f(x) = > A, SIN AnX 


n=1 


is uniformly and absolutely convergent there, and 


se 2, 2 
u(x,t) = Σ) 4, sin (Anxje Or ™ 


n=l 
converges uniformly and absolutely forO < x < L,t 2 0. In this case u(x, ἢ 
is continuous for 0 < x < L,t > 0, and the last boundary condition is satisfied 
in the stronger sense 


lim u(x, t) = f(*o) 
a 


for all xo in (0, 1). 
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EXERCISES 


1. Give a rigorous discussion to establish the validity of the formal solution of the 
boundary-value problem 
2 
Ou 2 Ou 
---- Ξ: Ω --» 
Ox2 Ot 
u(0,t) = u(Z,t) = 0, ¢ > 0, 
u(x,0) = f(x), O< x < L. 


2. Repeat Exercise 1 for 
a°u 2 Ou 
a ae 
u,(0, t) = u.(L,t) = 0, t > 0, 
u(x,0) = f(x), O< x < QL. 


3. Prove that Theorem 13—2 remains valid if the hypothesis ‘“‘nonincreasing” is replaced 
by “‘nondecreasing.”’ 


14 
boundary-value problems 


for laplace’s equation 


14-1 INTRODUCTION 


In this chapter we restrict our attention to boundary-value problems involving 
Laplace’s equation 

au δ᾽ δ᾽ 

5x2 ΞΕ ὃν a2 0 (14-1) 
in rectangular, circular, and spherical regions. The student will observe that (14-1) 
can be viewed as the special case of the heat equation in which du/dt = 0, and 
with this interpretation in effect its solutions are called steady-state solutions since 
they describe temperature distributions which are independent of time. Other 
interpretations of (14-1) and its solutions are given in various exercises throughout 
this chapter. 

Before Eq. (14-1) can be solved in a circular or spherical region it must be 
transformed to polar or spherical coordinates. The computations involved in 
making these changes are somewhat lengthy, and so to avoid interrupting our 
later work we dispose of them here and now. 

The polar coordinate form of Laplace’s equation is derived by introducing the 
change of variables 


x = rcos8, y=rsiné, | (14-2) 
in 
au | au _ Ὁ 
ΟΧΣ ὃν 7”? 


as follows. From (14-2) and the chain rule for differentiation we obtain 


τε = cos 0.5 + sin 9S" 
y (14-3) 
Ou 


, Ou Ou 
99 πιο Τὸ 
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and since the determinant of this pair of equations is nonzero everywhere in the 
punctured planer ~ 0, (14-3) can be solved for du/dx and du/dy whenever r * 0. 
This gives 


ou | cos got — 1 sing 
Ox or 00 
(14-4) 
Ou ; Ou 1 Ou 
ay = sin 6 + 7 COS O =, 


But these formulas are valid for any differentiable function u = u (x, y), and 
hence can be applied to du/dx and du/dy themselves to obtain 


δ'μ re δι. eu eeu Gee ὍΝ ᾽ 
Ox2 or \Ax r 00 \ax 


aus fou Ι 8 fau 
δα = sino 9 (M4) + bcos 05 (2) 


2 (34),..., ὃ. (}) 
Or \Ox 06 \oy 

are now computed from (14-4), substituted in (14—5), and the resulting equations 
added, we find that 


(14-5) 


If the derivatives 


au δι. au , Lou, 1 
ay? ~ are Fart ΤΣ 


δ᾽ 
δχ3 oy? 062 


062 


(see Exercise 1). Hence Laplace’s equation in 
polar coordinates is 


1 du 1 δ΄ 
teat pao ἀμ 


au 
or2 


FIGURE 14-1 
x 


To convert (14-1) to spherical coordinates (r, y, #) we make the change of 
variables 


x = rsingcos 8, 
y=rsingsin 6, 


Z = rcos ¢. 


(See Fig. 14-1.) A computation entirely similar to the one given above now yields 
the equality 


tu, uy Ou 1 ὁ (aM) 4, 1 2 (ig δὴ, 1 ah 
ax2 νῷ az2 72 ar\’ ar) ᾿ Pesing d9\" Ὅδο), Psin2o O02” 
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and it follows that Laplace’s equation in spherical coordinates is 


d( “δὲ 1 δί(. ou 1 δι 
or (- ou) ea φ I (sin » 8) τ Sin? yp 062 Ν (14-7) 


Incidentally, (14-7) was the equation originally encountered by Laplace in his 
study of gravitational attraction in three-space, and it was only later that he found 
the version 


fu, tu ou 
ax2 ' ay2 ' Qz2 — 


introduced earlier. 


EXERCISES 
1. Complete the proof of the equality 


1 au 


_du, 1d, 1 δ΄ 
r2 062 


Oy2 Or? r or 


ax2 ἢ τ 


2. Use the transformation formulas given in the text to derive Eq. (14-7) from (14-1). 


14-2 LAPLACE’S EQUATION IN RECTANGULAR REGIONS 


In this section we consider the equation 
2 2 
pL (14-8) 


in a rectangular region of the form 0< x << L,0<y< M, and begin by 
imposing the boundary conditions 


u0,y)= 0, u(L,y) = 9, 
u(x,M) = 0, = u(x, 0) = 70}. 


(14-9) 


In physical terms this problem requires that we find the steady-state temperature 
in a thin rectangular plate three sides of which are held at 0°, and the fourth at 
f(x), under the assumption that no heat is gained or lost across its faces. 

We again find the solution by separating variables, and thus set u(x, y) = XY, 
where X and ¥ are, respectively, functions of x and y alone. This implies that 
Ure = XY, μων = XY”, and hence (14-8) becomes 
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at those points where XY + 0. This equation in turn is equivalent to the pair of 
ordinary differential equations 
X" +X = 0, 


14-10 
Y” —rY = 0, 


λ a constant, and the given boundary conditions plus the requirement that 
XY # Oimply 
X(0) = X(L) = 9, 


11 
Y(M) = 0. die 


Hence we can again begin with the solutions of the Sturm-Liouville system 


X" +X = 0, 
X(0) = χὠ = 9, 


that is, with the functions 


ἤπχ 
L 


X,(x) = A, sin De ots 
where _X,, belongs to the eigenvalue \, = n?x?/L”, and A, is an arbitrary constant. 
For these values of \ the second equation in (14-10) becomes 
2 2 
now 
y" τς: Y = 0, 
and has the general solution 


Y,(y) = 8. sinh ΠΣ + C, cosh — (14-12) 
B, and C,, arbitrary.* Since Y(M) = 0, 
οι AT nw 
B,, sinh Ὑ M + C, cosh -τ- M = 0, 
and we can set 
nw . , aT 
B= —cosh = M, C= sinh -Ὑ- M. 
We now substitute these values in (14-12) and use the identity 
sinh a cosh 8 — cosha sinh B = sinh (a — 8), 
valid for all a and β, to obtain 
Y,(y) = sinh Ἢ“ (M — y). (14-13) 


* In this problem it is more convenient to work with hyperbolic functions than with 
exponentials. 
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Thus each of the functions 


U(x, vy) = 4, Sin (7) sinh “* (M— y) n= 1,2,..., (414) 


is a solution of the two-dimensional Laplace equation which, in addition, satisfies 
the boundary conditions 


Un(O, y) = Un(L, y) = un(x, M) = 0. 
To find a solution which also satisfies the remaining boundary condition 
u(x, 0) = f(x) we form the series 


οΌ 


>) προ, }) 


n=! 


u(x, y) 


=< . (NeX\ .., ne 
᾽» A, sin (1) sinh ΟΜ — 9). 
When y = 0 this series becomes 
u(x, 0) = > An sinh (=) sin = 3 
n=1 


and will represent the function f on the interval (0, L) if the A, sinh (17M /L) are 
the coefficients of the Fourier series expansion of the odd extension of f to [—Z, L]. 
Thus 


L 
. , nrM 2 . {nxx 
A, sinh uaa oP f(x) sin ("**) dx 


and 


L 


[ L : 
Jo Fix) sin (nef) a (=) sinh = (M — y). 


2 
u(x,y) = F 
n=1 


(14-15) 


Once again it can be shown that this solution is valid whenever f is sufficiently 
smooth (see Exercise 10), and that it is the only possible solution of the problem 
in question. 

It is clear that the above argument can be applied to solve any boundary-value 
problem for Laplace’s equation in a rectangular region given that the solution is 
to vanish on three sides of the rectangle. But if u1, uw, u3, u4 denote the solutions 
corresponding to the four possible cases with one nonzero boundary condition, 
the function 


4 
u(x, y) = >= ux(x, γ) 


k=1 
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will be a solution assuming nonzero values on ail four sides of the rectangle, and 
it follows that we can actually solve all problems involving Laplace’s equation 
and boundary conditions of the form 


u(0, y) ΞΞ AiO), u(L, y) = Sol) 
u(x, 0) = f(x), u(x, Μὴ = fal). 


EXERCISES 


In each of the following exercises find the solution of Laplace’s equation in the rectangle 
0<x<L,0< y < M which satisfies the given boundary conditions. 


1. 
2. 


_u(x,0) = u0,y) = 0, u(x, M) = x sin» u(L, y) = y sin 


u(O, y) = u(L, y) = 0, u(x, M) = u(x, 0) = 2x(x — 1) 
u(L, y) = u(x, 0) = 0, 


< 
asm) =f ae 
Ι,--χ, 1722 4 χᾳ«] Ι, 
» 0< y < M/2 
Ὁ.» =P ἈΞ 
M—y, M/2<y<M 
. uO, y) = u(Z, y) = 0, 
0, 0<x<5 
u(x, M) = u(x, 0) = 3. 1 on 
a 2 1} OS 


Wy 


. u(x, 0) = u(x, M) = x(x τ 71), μ(0, y) = u(L, y) a sin = 


. Find the series solution of the equation uz, + uyy = Oind<x<L0o<y<M 


given that 
u0,y) = fid), UL, y) = feb), 
u(x,0) = f3(x), u(x, M) = fa). 


. Derive the formula for the steady-state temperature in a 7 X π᾿ square plate whose 


faces are insulated so that no heat flows across them, under the assumption that 


uz(0,'y) = ust, y) = μ(χ,π) = 0, μίχ,0) = FO). 


. Solve uzz + uy, = Ο in the region0 < x < 7,0 < y < π, subject to the bound- 


ary conditions 


uz(r, y) = ur(0,y) = uy(x,7) = 0, = u(x, 0) = f(x). 
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9. Find the steady-state temperature in the infinite plate shown in Fig. 14-2 if the 
vertical edges are kept at 0°, the edge on the x-axis at 100°, and if the temperature 
throughout the plate is bounded. 


y 


FIGURE 14-2 


#10. (This Exercise assumes a knowledge of the material in Section 13-9.) When M = 
L = x the boundary-value problem discussed in this section is 


u(x,7) = u(0, y) = uGr, y) = 0, 
u(x, 0) = f(x), 


and the formal solution found may be written 


sinh n(x — y) 
—_—____—_—__——— 
sinh μπ 


u(x, y) = >> An sin (nx) 


n=1 


where >_%_, A, sin nx is the Fourier series expansion of the odd extension of f to 
the interval [—7, 7]. 


(a) Show that the sequence of functions 


i nr — »| 
——____-__-“'5 n= 1,2,..., 
sinh na 


is monotone nondecreasing and uniformly bounded on 0 < y < a. (In fact, 


0 « sinh nr — y) <1 

sinh 27 
for all 7.) 
(b) Assuming that f and /’ are piecewise continuous on 0 < x < 7, show that 
the formal solution given above is: uniformly and absolutely convergent in the 
rectangle Ὁ < x < 7, yo < y < @ for any yo > 0. [Hint: Use the methods of 
Section 13-9, including that of Exercise 3.] 
(c) Show that under the assumptions given in (b) the series obtained by twice 
differentiating the formal solution term-by-term with respect to x and with respect 
to y are also uniformly and absolutely convergent on 0 < x < 7, yo <y<n. 


14-3 | LAPLACE’S EQUATION IN A CIRCULAR REGION 553 


(d) Using the results of (Ὁ) and (c), prove that the series solution u(x, ἢ) satisfies 
Laplace’s equation in the rectangle 0 < x < 7, 0 < y < =, and vanishes when 
x = wand when y = Oandz. 

(e) With f and f’ as above, prove that lim,_,o+ u(xo, y) = f(xo) for each xo in 
(0, +), and thus show that u(x, ὃ) is a solution of the given boundary-value problem. 
(Ὁ Prove that the solution u(x, y) satisfies the boundary condition u(x, 0) = f(x) in 
the stronger sense 


lim u(x, y) = f(xo) 


tI—~Zo 
y— Ot 


for all xo in (0, πὴ whenever f is continuous and f’ piecewise continuous on [0, π]. 


14-3 LAPLACE’S EQUATION IN A CIRCULAR REGION; 
THE POISSON INTEGRAL 


As our next example we solve Laplace’s equation in a circular region centered at 
the origin. In this case we must use the polar coordinate form of the equation 
which, as we have seen, is 

δι lou, 1 d7u 

—-+-—+-—.5 2; = 0. 14-16 

or? εἰ ror r? 06? ( ) 
Here, in addition to the usual series solutions obtained by the method of separa- 
tion of variables, there are certain exceptional solutions which depend upon only 
one of the variables, and we begin by examining them. 

First, if u is a function of r alone, (14-16) becomes 


ts ae 0 (14-17) 
or 
d ( ἐμ 
dr { 4) °, 
and two integrations yield 
u = οἴῃ (kr), (14-18) 


where cand k > Oare arbitrary constants. In this case the solutions are undefined 

when r = 0, and hence are valid only in regions of the form r > Ὁ where they 

provide solutions of (14-16) which are constant on circles centered at the origin. 
On the other hand, if u is a function of 6 alone, we have 


d7u 


age 


and u = 40 - B, where A and B are arbitrary constants. If we now demand 
that u be single-valued (which is clearly the only type of solution of any physical 
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significance), then u(@ + 27) = u(@), A = Ο, and it follows that (14-16) has no 
nonconstant solutions which depend only upon the polar angle 8. 

This’ said, we return to Eq. (14-16), which we now solve under the assumption 
that u is single-valued, continuous, and assumes preassigned values on the boundary 
of the circle. For convenience we shall work in the unit circle r < 1, in which 
case the boundary condition can be written 


u(1, 6) = (9), (14-19) 
where f is a continuous function such that f(6 + 27) = /(6) for all 9. 
Setting u(r, 0) = R(r)O(@), (14-16) becomes 
R'@ ++ RO + 4 RO" = 0, 
r r 
and we have 


2 
r°R” + rR’ 0” _ | 
ge eg A, A aconstant. 


This yields the pair of ordinary differential equations 


Θ΄ + 00 = 0, 


r2R” + rR’ — XR = 0, rae 


the first of which is subjected to the periodic boundary conditions 0(0) = O(2z). 
Save for notation, this problem was solved as Example 2 in Section 12-5, where 
we saw that its eigenvalues and eigenfunctions are 


λ, =n’, n=0,1,2,..., 
and 
Θ(θ) = A, cos né + B, sin née. (14-21) 


Moreover, when \ = \, = n”, the second equation in (14-20) becomes 
r?R’ + rR’ — n’?R = 0, (14-22) 


which we recognize as an Euler equation whose solution space is spanned by the 
functions r” and r~” whenn = 0. and 1 and Inr when n = 0 (see Section 4-8). 
We reject the solutions r—” and In because of their discontinuity at the origin, 


and thus are left with 
ΜΚ, = r”. (14-23) 


This done, we combine (14-21) and (14-23) to obtain the functions 
un(r, 0) = r"(A, cos πθ + B, sin πθ), 


each of which is continuous, satisfies Laplace’s equation, and is periodic in @ with 


14-3 | LAPLACE'S EQUATION IN A CIRCULAR REGION 555 


period 27. To satisfy the boundary condition u(1,0) = (6), we now form the 
series 


u(r, 0) = 3. Ἔ > r"(A, cos né + B, sin πθ), (14-24) 


n=lI1 


and set r = 1. This gives 


u(1, θ) = 4 + Σ᾽ (A, οοβ πθ + B, sin n6), 


n=l 


and it follows that the constants A, and B, must be the Fourier coefficients of /; 1.e., 


Yo : | ΠῚ cos n6 de, 


(14-25) 


B, = 1 ΚΘ) sin n@ dé. 


Finally, we leave the reader the task of verifying that whenever / is sufficiently 
smooth, (14-24) and (14-25) provide a continuous, single-valued solution of 
Laplace’s equation in the unit circle which assumes the prescribed values on the 
boundary of the circle. The argument needed to establish these facts is outlined 
in Exercise 7 below. 

We have already observed that the solution of the above boundary-value prob- 
lem can be interpreted as the steady-state temperature distribution in a circular 
region of radius one, given the temperature on the boundary of the region. There 
are, however, other physical interpretations of this solution (and, by implication, 
of the problem leading to it) which are of considerable importance in more advanced 
work. Most of them are derived from an integral form of the above solution, 
which is obtained as follows. Let s denote the variable of integration in (14-25), 
and substitute in (14-24). This gives 


u(r, 0) = tf S(s) ds + > r” ( 
--- ἸΠΡΒΤ —T 


2 ( ᾿ f(s) sin ns 4) sin n | ; 


Interchanging the order of integration and summation (an operation which can 
be shown to be valid here), this expression may be rewritten 


κ 


f(s) cos ns as) cos n6 


u(r, 6) 1 [! f(s) E + » r"(cos ns cos nO + sin ns sin no)| ds 


n=1 


Ι 


: | f(s) i -+- 3 r” cos n(s — ἢ ds. 
x n=1 
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We now evaluate the sum 


I 


Ὁ 


ἜΣ) r*cosn(s — 8) (14-26) 
n=1 


appearing in this integral. The easiest way to go about this is to introduce complex 
numbers, and set 


z = r[cos(s — 6) + isin(s — 6)]. 
Then 
z” = r"[cosn(s — 6) + isinn(s — 9)], 


and it follows that (14-26) is the real part of 
2 n=1 ) 


But when |z| = r < 1, as it is here, the geometric series 1 + z+ 27+ "τ" 
converges to 1/(1 — z). Hence 


1 =~. on ] 
2, Ὁ Ἐν Διὁὦψρ,ω 41 3 ν᾿ 
] | 

αὐ πον: 
es, eae oe Be ςς 
" — 371 [= |reos(s -- 6) + irsin(s -- 8) 
_ Ξι πΣ, a ea μετ 
~~ 2 1 — 2rcos(s — 6) + Pr? 


Taking the real part of this expression we have 


] l -" 1 1 — rcos(s -- @) 
re|— 3+ 745|- —271T- eos —-0)+P 
ect te 
2 — 2r cos (s — 6) + r2) 
and it follows that 
_1-” [ f(s) 
ee oe On J_,1 — 2rcos(s — 6) + Pr? ὼ er) 


This expression is known as the Poisson Integral form of the solution of Laplace’s 
equation in the unit circle with boundary condition u(1, 6) = f(@), and, as men- 
tioned above, appears in advanced work in this subject. 
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EXERCISES 


1. Use the technique suggested in Example 3 of Section 4-8 to show that u = c ln (Ar) 
is the general solution of 


2. Verify that r” and r—” are solutions of 
r2R” + rR’ — n?R = 0. 


3. A thin homogeneous annular disk, having dimensions as shown in Fig. 14-3, is 
insulated so that no heat can flow across its faces. Find the steady-state temperature 
throughout the disk if the inner boundary is kept at 0°, while the outer is kept at 
100°. At what points in the disk will the temperature be 50°? 


y 


FIGURE 14-3 FIGURE 14-4 


4. If a doubly infinite straight wire carries a uniform static electric charge o per unit 
length (¢ > 0), then the potential at a point P due to the charge on an element of 
the wire of length dx is defined to be 


where R; and Ro are as shown in Fig. 14-4, and the distance OQ = 1. By experi- 
ment it can be shown that the potential V(P) at P is the “‘sum”’ of the potentials due 
to the various elements of length, 1.e., that 


“(1 1 


Set OP = r, and evaluate this integral. Compare the result obtained with the 
§-independent solution of the two-dimensional Laplace equation. 

5. Refer to Appendix I to obtain sufficient conditions on f(@) to permit the necessary 
interchange of the order of integration and summation in the derivation of the 
Poisson integral. 


558 BOUNDARY-VALUE PROBLEMS FOR LAPLACE'S EQUATION | CHAP. 14 


6. Verify directly that the Poisson integral satisfies Laplace’s equation when r < 1. 
(See Appendix I for the necessary rule for differentiating the integral.) 
*7. (This exercise assumes a knowledge of the material in Section 13-9.) Assume that 
F(@) and f’(@) are piecewise continuous and periodic on [0, 27] with period 27, and 
that 


£6) = 31f*) + f@)) 


everywhere in this interval. Prove that 


Ao | Sn 
u(r, 8) = = + Σ᾿ (An cos.nd + Br sin né), 
n=1 


where 


Ao = 
f@) = ee + d, (A, cos nO + B,, sin n@) 


is a solution of the boundary-value problem discussed in this section. Reason as 
follows: 

(a) Show that |A, cos nO + B, sinn6| < VA; + BR Oasn— ©. 

(b) Show that the solution series and all relevant series obtained from it by term- 
wise differentiation converge uniformly and absolutely whenever r < ro < 1. Now 
conclude that the necessary termwise differentiations can be performed, and that the 
solution series does satisfy Laplace’s equation in the region r < 1. 

(c) Show that lim,_,1— u(r, 60) = f(@o0) for all θο in [0, 27]. 

(4) Prove that if £(@) is also continuous then the boundary condition is satisfied in 
the stronger sense 


lim u(r, 0) = f(8o). 
6-8 
γΩ Ἱ 


14-4 LAPLACE’S EQUATION IN A SPHERE; 
SOLUTIONS INDEPENDENT OF 0 


The remaining sections of this chapter will be given over to the study of Laplace’s 
equation in the unit sphere r < 1 where, as we have seen, the equation can be 


written 
a(su\, 1 δύ, , a) 4 1 ou _ 
ar (- | eee OG (sin ) Mie ape 22) 


As usual we shall restrict our attention to solutions which are single-valued, 
continuous, and bounded in the region under consideration, and which as a conse- 
quence are periodic in @ with 27 as a period. With these assumptions in force it 1s 
easy to show that (14-28) has no nonconstant solution involving only one of the 
variables. Under less restrictive hypotheses, however, solutions of the latter 
type do exist, but since they can be found without difficulty they have been left 
to the exercises. 
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In this section we solve (14-28) under the assumptions that the solution is 
independent of 6, and that μ is known when r = 1; 1.6., u(l,¢) = f(y). Then 
82.902 = 0, and (14-28) assumes the somewhat simpler form 


2 
pou ar δ ἜΣ Fa 3: Ὁ (14-29) 
or2 ὃφ 

We now apply the method of separation of variables, this time with u(r, ¢) = 
R(r)®(¢), to obtain the pair of equations 


γ Κ΄ + 2rR’ —r~R=0, O<r <i, (14-30) 
and 
©®’ + coty @  λῷ Ξ 0, O<gy<r, (14-31) 


λ a constant, which can be solved as follows. 
Set s = cos¢ in (14-31). Then 


ge eZ — sin 6: de = sin” de — cos is 
dp ds = dg? ? “ds? Pads 


and we have 
2 


; α΄ Φ d® 
2 =o 
sin” φ 132 2 cos φ ds + Ab = 0, 
or 


(1 TP _ 25 + nb = 0, Se = 1. (14-32) 


But this is none other than Legendre’s equation, and hence the eigenvalues for the 
problem under consideration are the integers \, = n(n + 1),n = 0,1,2,... . 
(see Example 4, Section 12-6). Since the corresponding eigenfunctions for (14-32) 
are the Legendre polynomials P,,(s), it follows that the functions 


®,(¢) = Pn (cos φ), n = 0,1,2,..., (14-33) 


are the eigenfunctions for (14-31) under the given boundary conditions. 

Next we observe that (14-30) is an Euler equation. Moreover, when ἃ = ἃ; = 
n(n + 1), an easy computation shows that its solution space is spanned by the 
pair of functions 

R,(r) = r™ ~~ and — RR, (7) = or FP, 


and since the second of these solutions must be rejected because of its discontinuity 
at the origin, we conclude that the relevant solutions of (14-29) are 


Un(r, ¢) = Anr"P, (cosy), n= 0,1,2,..., (14-34) 


where A,, is an arbitrary constant and P,, is the Legendre polynomial of degree 1.* 


* By definition, uo(r, ¢) has the value Ag at the origin. 
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Finally, to satisfy the boundary condition u(1, ¢) = f(¢) we form the series 


u(r, φ) = 2 Anr"Pa(cos ¢), (14-35) 


n=0 


and determine the 4,, so that 
fe) = >> AnPr(cos ¢) (14-36) 
n=0 


for all φ in the interval [0, x]. To this end we again set s = cos ¢ and rewrite 
(14-36) as 
ficos~’ 5) = ἊΝ A,P,(s), 
n=0 


in which form it is obvious that the 4, must be chosen as the coefficients of the 
Legendre series expansion of f(cos~' 5); i.e., 


1 
ΓΞ at | οος 1 s)P,(s) ds 
=| 


(14-37) 


2 ' 
- 55 a i f(¢)Pr(cos ¢) sin ¢ de. 


Using these coefficients, (14-35) will converge in the mean to f(y) when r = I. 
Moreover, as in all of the preceding examples, it can also be shown that this series 
is uniformly and absolutely convergent, and twice differentiable term-by-term with 
respect to each variable whenever / is sufficiently smooth (see Exercise 13). This, 
of course, implies that (14-35) is a solution of the given boundary-value problem, 
and since this problem has a unique solution (see Appendix IV), we are done. 

Before going on, there is one rather interesting aspect of these results which 
deserves closer attention. It concerns our apparent success in obtaining an 
orthogonal series expansion for the function f(¢) defined on the surface of the 
unit sphere, which, after all, is the import of the assertion that 


ys A,P,(cos φ) 
n=O 


converges in the mean to f whenever the A, are given by (14-37). One can, of 
course, adopt the pedestrian point of view which sees this result as nothing more 
than a statement of standard facts concerning Legendre series. However, a more 
liberal and suggestive interpretation is possible by incorporating this result within 
the context of orthogonal series expansions, as follows. 

Let @,(S) denote the set of all real-valued continuous functions defined on the 
surface of the unit sphere and dependent only on the variable ¢ (φ = colatitude 
on the sphere). Clearly @,(S) is a real vector space under the usual definitions of 
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addition and scalar multiplication, and also becomes a Euclidean space if we set 


f-g = [{ fee) 4s, (14-38) 
5 


where the integral in question is taken over all οἵ S. Integrals of this sort are known 
as surface integrals and are discussed in Appendix IV. For now we need know 
only that they enjoy all of the standard properties of linearity (a fact which is 
implicit in the statement that f- g is an inner product), and that they can be 
evaluated as ordinary iterated integrals. Indeed, when S is the surface of the unit 
sphere, it can be shown that 


[[foswas = [ [᾿ fes(o) sin ἀρ 49." (14-39) 
ς 0 0 


Thus (14-38) may be rewritten 


fra =[" [Mego sin ἀρ do 


Ι 


25 [᾿ fle)g(e) sin ἀρ, 
0 


and can be evaluated in a perfectly routine fashion. 
Now let P,, (cos ¢) denote the nth Legendre polynomial, viewed as a function 
in @,(S). Then 


Pm? Pn = 24 [ ᾿ Ρ,ι(οοβ ¢)Pn(cos φ) sin φ de, 
0 


and thus if we make the change of variable 
S = COS g, we obtain 


Pi spe 25 i τ᾿ P..(s)P,(s) ds 
1 
1 
=e | P,,(S)Pn(s) ds 
—1 
0 ifm ᾽ξ ἢ, 
EO hye tee FIGURE 14-5 


* This equality can be motivated by observing that the integral on the left is taken 
over the surface of the unit sphere, described by letting ¢ vary from 0 to z, θ from 0 to 27. 
Since an element of surface dS on a sphere of radius r is given by the expression 


dS = (rsing dé)(r dp) = r* sing de dé, 
(14-39) follows by setting r = 1. (See Fig. 14-5.) 
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FIGURE 14-6 


(See Theorem 11-6.) Thus the functions P, (cos ¢),n = 0,1,2,..., are mutually 
orthogonal in ©,(S), and the series given in (14-36), with coefficients as in (14-37), 
is the orthogonal series expansion of fin terms of the P,, (cos yg). From this point 
of view the statement that this series converges in the mean to f is equivalent to 
the assertion that the P,, (cos ¢) form a basis for C,(S), a fact which is proved in 
exactly the same way as the corresponding statement for the Legendre polynomials 
in the space PC[—1, 1]. 

The functions P,, (cos φ) appearing in this discussion are known as surface zonal 
harmonics, or simply zonal harmonics.* The use of the term “harmonic” is ex- 
plained by the fact that any solution of Laplace’s equation, and thus, in particular, 
P,, (cos ¢), is said to be a harmonic function. The term “zonal” is applied because 
the curves on the surface S of the unit sphere along which P,, (cos ¢) vanishes are 
parallel to the equator of S and thus separate S into “zones.” Indeed, using the 
fact that the Legendre polynomial of degree n has roots x,,..., Xn in the open 
interval (—1, 1) (Theorem 11-7), it follows that the zeros of P, (cos φ) consist 
of the parallels of latitude on the unit sphere given by g; = cos’ x1,...,¢2 = 
cos~!x,, 0 < 9; < mw. These curves determine the zones alluded to in the name 
zonal harmonic (see Fig. 14-6). 


* Some authors reserve the latter term for the functions r”P,,(cos ¢). 
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EXERCISES 


1. 


10. 


11. 


. Α semi-infinite wire coincides with the posi- 


Verify that the solution space of the equation 
r2R" 4+ 2rR' — XR = 0 


is spanned by the functions r” and r—“+) when dA = nm + 1). 


. Find the general solution of Eq. (14-28) which depends only on r, and which 


vanishes at infinity. 


. Show that (14-28) has no nonconstant single-valued solution which depends only 


on @. 


. Find the general solution of (14-28) which depends only on ¢. 
. Use the results of the preceding exercises to show that under the conditions assumed 


in the text (14-28) has no nonconstant solutions which involve only one of the 
variables r, φ, 0. 


tive z-axis, and carries a static electric charge 
o per unit length (o > 0), while a similar 
wire, oppositely charged, coincides with the 
negative z-axis. Given that the potential at 
a point P in space due to the charge element 
o dz is σ dz/R (see Fig. 14-7), perform the = ~——""7> y 
appropriate integration, and find the poten- 
tial at P due to the entire (doubly infinite) 
wire. Compare your answer with the result 
obtained in Exercise 4. x FIGURE 14-7 


. Find a solution u(r,¢) of Laplace’s equation in the region |r| > 1 given that 


μ(1, φ) = f(¢). 


. Let u(r, ¢) be the steady-state temperature in a spherical shell of inner radius a, 


outer radius ὃ. Find u(r, ¢) if μία, φ) = fv), ub, ¢) = 0. 


. Find the steady-state temperature in a homogeneous sphere of unit radius when 


the surface is maintained at the following temperatures. 
(a) cos? y (b) cos 2¢ (c) 2sin?g — 1 (d) sin*t ¢ 
Suppose that 


7 δ᾽ 
τς Ξ 0, 
k=1 OX; 
where u = u1(x1)°**Un(x,). Prove that 
4} 
ἐκ 
ao Ax, Ax, aconstant, kA = 1,...,n, 

k 


and that}; + -:-°: +A, = 0. 


Find the steady-state temperature in a homogeneous hemisphere of radius 1, given 
that the temperature is independent of longitude, that the flat surface is kept at 0°, 
and that the remainder of the surface has temperature /(~), where f(7/2) = 0. 
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12. Solve the problem in Exercise 11 when f(y) = cos* y — cos ¢. 
*13. Let fe) = 41f¢* + f()] be piecewise continuous and periodic with period 
27, and let f’(~) be piecewise continuous for all ¢. 
(a) Prove that the series 


u(r, ¢) = > Anr' Pr (cos ¢) 
n=0 


constructed in the text is uniformly and absolutely convergent for r < ro < 1, 
0< » < x. [Hint: Recall that under these assumptions the Legendre series for f 
converges in the mean to f, and hence that there exists a real number M such that 
[4,| < M for all n. Then use the fact that |P,(x)| < 1 for -1 <x <1. (See 
Exercise 15, Section 11-3.)] 

(Ὁ) Given that |P®(x)| < n?* for —1 < x < 1, where P,” denotes the kth 
derivative of P,, prove that the series in (a) may be twice differentiated term- 
by-term with respect to either variable, and that the resulting series still converge 
uniformly and absolutely forr < ro < 1, 0< @< @. 

(c) Use the result in (b) to show that this series is a solution of Laplace’s equation 
in the region r < 1. 

(d) Prove that 


lim u(r, ¢o) = fo) 


τω} 
for fixed go. 
(e) Prove that 
ea u(r,¢) = fo) 


¥—¥0 


whenever >_%_9 4,Pn(cos φ) converges uniformly to f(¢) on the interval [0, 7]. 
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In this section we solve Laplace’s equation in the spherical region r < 1 subject 
only to the requirement that the solution be continuous, single-valued, and take 
on preassigned values when r = 1. Thus we consider the equation 


8 ( 9 ϑιι 1 of. δι 1 85 
-- mo —— -- --- -----ρ0 14-40 
or ( 3 T sing d¢ (sin e au) ει sin? φ 002 ( ) 
in conjunction with the boundary condition μά, ¢, θ) = f(e, 9), where f 15 
continuous on the surface of the unit sphere. 

Here we begin by seeking solutions of the form u(r, φ, 0) = R(r)P(¢)0(4), and 


substitute in (14-40) to obtain 


r2R! +. 2rR! Φ" + cot φ & 1 a 
EEN ah eee le ΤΕ es bes fy: 4- 
R T ® sinr 9 Θ : aa 
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Since the first term in this equation depends only on r, while the second is inde- 
pendent of 7, we have 
PR Rao 
ane ΝΣ , 
λ a constant, or 


r2R”’ + 2rR’ — XR = 0. (14-42) 


But for each value of \ the functions 7“, a = 4(—l1 4 V1 + 4), are a basis 
for the solution space of this equation (see Exercise 1). Thus if we demand that 
a be an integer (which we do for the sake of simplicity) it follows that 
= mm - 1),m = 0,1,2,..., and thata = m, ora = —(m- 1).* Hence, 
in this instance, the relevant solutions of (14-42) are 


Rw) He”. m= Ὁ. 1, 2 ves (14-43) 


the solutions γ 1 1) being rejected for reasons of continuity. 
Next, we use the chosen values of ἃ to rewrite (14-41) as 


©” + cot φ Φ' Ι Θ΄ 9 
Φ sin2o © : 


mim + 1) + 


or aS 
i} 


τ sin? ἢ =0. (14-44) 


0 


Thus Θ΄7Θ is also constant, and the requirement that © be periodic with period 
2x implies that 


Θ΄ 5 _ 
eo 77, n= ΟΣ 12 oss 


Hence the admissible values of © are 
©,(0) = A, cosné + B, sin né, (14-45) 


A, and B, constants,n = 0,1,2,.... 
Finally, when 0” /0 = —n?, (14-44) becomes 


2 
©” + cot gy?’ + acm + 1) - = |e = 0, (14-46) 


an equation which we now solve by means of the following ingenious argument. 


* The reader who feels that we have been somewhat ruthless in discarding potential 
values of ἃ should realize that we are only trying to find a single solution of (14-40) which 
satisfies the given boundary conditions, and the fact that the above choices lead to such 
a solution will furnish a postiori justification for making them. Of course, the heart of 
the matter lies in a uniqueness theorem which can be cited to prove that nothing is lost 
by this line of reasoning. 
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Set s = cosy. Then (1446) becomes 


(1 es — 2s o + mcm Ἔ1) -- ὶ mle =0, (14-47) 


and in this form is reminiscent of Legendre’s equation of order m. To exploit 
this similarity we make the second change of variable 


ᾧ = (1 — s?)"'?w. 
Then 


ds ds 1 — s? 
n/2 ae 2ns dw 1 -- s*(n — Dy]. 


e {1085 sya ae fa |: 


d*® 
ge δ 


and (14-47) becomes 


ds? 1—s2 ds” (i — s?) 


2 
(1 — s?) as — 2(n + 1s . + [mm + 1) — nv + lw =0. (14-48) 


On the other hand, we know that P,,, the Legendre polynomial of degree m, 
satisfies the equation 


(1 — εν! — 2sy’ + mim + ly = 0 (14-49) 


on [—1, 1]. Hence P®, the nth derivative of P,,, satisfies the equation obtained 
by differentiating (14-49) n-times with respect to 5. Performing these differentia- 
tions we obtain, successively, 
( — sy — 2(2s)y” + [m(m + 1) — 2]? = 0, 
(1 — εν — 3(2s)y + [m(m + 1) — 23) = 0, 


( — s2yyF2 — (n + 1Qsy"4P + [mm + 1) — nln + DY = 0, 


and since the last of these equations is just another form of (14-48), it follows that 
P™ is a solution of that equation on [—1, 1]. When rewritten in terms of φ we 
find that 

Enn(y) = sin” φ Pm (COs ¢) (14-50) 


is a nontrivial solution of (14—46) on [0, π] for each pair of non-negative integers 
mand n,n < m.* 


* Since P», is a polynomial of degree m, Py,’ will be nonzero only if nm < m. 
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Combining the solutions found in (14-43), (14-45), and (14-50) we obtain the 
functions 
r”(Amn COS NO + Bmn sin nd) sin” ¢ Py(cos ¢), 
n=0,1,...,m, m=0,1,2,..., 


Amn: Bmn constants, 


each of which is a solution of (14-40). To complete the discussion we now use 
these functions to construct a solution u(r, ¢, 8) which also satisfies the boundary 
condition u(1, φ, 0) = f(y, 6). The student will recognize the method. 

Let @(S) denote the Euclidean space composed of all continuous functions 
defined on the surface S of the unit sphere with inner product 


f-g = ff fle, ge, 6 45 
S 
25 τ ᾿ 
= [ [ f(g, gly, 9) sin φ ἀφ do, 
0 0 
and let 
Umn(¢, θ) = Cos (n@) sin" φ Pi, (cos φ), (14-51) 


Umnle, 0) = sin (10) sin” » Pm (005 ¢), 


where m and n are as above. These particular functions are known as spherical 
harmonics, and for each fixed value of m the 2m + 1 functions 


Um0> Um15 +++ 3 Umm, Umi1,-++5 Umm 


are called the spherical harmonics of order m. \n the sections which follow we will 
prove that these functions are a basis for C(S), and hence that f(¢, 6) can be 
written in the form 


fe) = >> ea ep ΕΣ ict Bann) | (14-52) 


m=0 n=1 
where the series converges in the mean to f, and 


2π Tr : 
Amo _ f+ Umo _ [9 16 0, θ) sin ¢ Pm(cos φ) de 49. 
2 ||Umol|? Umo * Umo 


4, — £2 tm _ Jo" Jo fle, 8) cos (10) sin”**  Pr(cos ¢) de dd 


we || Umnl|? Umn * Umn 


2x nr . ese 
ftmn _ So” [5 Κρ, θ) sin (n0) sin"+* y PL(cos 9) ἀρ dd , 
l|Umn ||? Umn *Umn 


Bmn = n τέ 0. 
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As usual, when fis sufficiently well behaved this series is twice differentiable term- 
by-term with respect to each variable, and the series 


u(r, Ys 6) = 2 γ᾿ es Umg + >. (AnnUmn + Brann)| 


m=0 2 n=1 


is the solution of the given boundary-value problem. 


EXERCISES 


1. (a) Find the general solution of 


r2R"” + 2rR’ — r\R = 0 
on (0, ~). 
(b) Prove that this equation has solutions of the form r*, k a non-negative integer, 
if and only if\ = m(m + 1),m = 0,1,2,.... 
2. Use mathematical induction to prove that the mth derivative of a solution of 
Legendre’s equation of order m is a solution of 


(1 — x?)y™F2 — 2(n + Ixyt) + [mm + 1) — rn - 1)» = 0. 


3. Compute the spherical harmonics of orders 0, 1, and 2. 


4. Make the substitution u(r, ¢, 0) = r°F(¢, 6) in (14-40) to obtain a partial differential 
equation for F(y, 9), and then set s = cos ¢ to obtain 


°F 2, [ὃ 2, OF Ε 
362 7 ( -- *)(2l -- oF) 4 men + DF| = 0. 
Solve this equation by the method of separation of variables, and compare the 
results with those in the text. 


14-6 ORTHOGONALITY OF THE SPHERICAL 
HARMONICS; LAPLACE SERIES 


To complete the discussion of the last section we must show that the spherical 
harmonics 
Umn(?, 9) = cos né sin” φ P® (cos ¢), (14-53) 


Umn(¢, 0) = sin né sin” φ Px(cos ¢), 


n= 0,1,...,m; m= 0,1,2,..., are a basis for the Euclidean space @(S). 
(We assume throughout that 2 ~ 0 in Um».) As usual, the proof is divided into 
two parts; a straightforward computation to establish orthogonality, and a 
sequence of theorems culminating in the assertion that the umn, Umn generate 
e(S). We begin with the proof of orthogonality, which in this case requires 
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that we show | 
Umn* Urs = Ὁ whenever m τέ r orn τέ 5 (or both), 
Umn* Vrs = Ὁ whenever m τέ rorn  s (or both), (14-54) 


Umn* Urs = Ὁ for all m,n, r,s. 


Recalling that inner products in C(S) are computed as twofold iterated integrals 
according to the formula 
2π 


7 ε- [ [ " fle, ge, θ) sin φ dy dé, (14-55) 


we have 
2π wT. 
Umn’ Urs = [ cos n@ cos 50 dé [ sin’ tét! 4 P™ (cos φ)Ρρί)Ἶοοβ φ) dy. 
0 0 
Thus ifm τέ 5, Umn* Urs = Ὁ since the first integral in this expression vanishes. On 


the other hand, if πὶ = 5, then m ¥ r and the equation μριη urs = 0 will be 
satisfied if and only if 


τ 
[ sin?” t+! 4 P& (cos )P(cos φ) ἐφ = 0, 
0 


or, making the substitution x = cos g, if and only if 
1 2 
[ Cl -- x?) P(x) P(x) dx = 0. (14-56) 
| 
To establish this equality we recall that P® and P\” satisfy the identities 


( — x*)Pet® — In + 1)xPStP + [m(m + 1) — nin - 1)P& = 0, 


( — ΧΡ — 2m + ΧΡ + [rr + 1) -- nf + LPF? = 0, 
(14-57) 


throughout the interval [—1, 1]. We now multiply the first of these expressions 
by (1 — x?)"P™, the second by (1 — x?)"P®, and subtract to obtain 


@ ia ΧΡ op’) > ΡΟ ΕΘ pony 
— An + 1)χᾳ -- χ ΡΤ ρ. petbpey 
= [r@ + 1) -- m(m + DMC -- x°)"P Pr”. 


But by setting Ppaethp® - ΡΤ ρα) = y, the left-hand side of this identity 
may be rewritten 


d ἡ 
7x ἃ — x?) tty], 
and we have 


<u — Χο Fly] = [rir + 1) — mom + 1]( — x? )"PP PP. 


570 = BOUNDARY-VALUE PROBLEMS FOR LAPLACE'S EQUATION | CHAP. 14 
Integrating from —1 to 1 gives 
[rr + 1) — m(m + 1} ( — x2 PRPPL de = 0, 
and since m ¥ r, 
[ ᾿ (1 -- x2)"P™p™ dy = 0, 


as desired. 

To complete the proof we observe that the above argument applies equally well 
to the vz», and shows that Un» "γε = Ὁ whenever m ~ rorn # 5. Finally, the 
vanishing Of umn-*Urs for all m, n, r, s is an immediate consequence of the or- 
thogonality of cos n@ and sin s6 in C[0, 27], and we have 


Theorem 14-1. = The spherical harmonics are mutually orthogonal in the 
Euclidean space of all continuous functions on the unit sphere. 


For future use we take formal note of the following obvious consequence of this 
result. 


Corollary 14-1. For each fixed value of m the (2m + 1) functions 
EF Unie ας ὦ Wie fh εν Seal Cnn 


are linearly independent in the space of all continuous functions defined in 
the regionr 3 1. 


Indeed, were it possible to express one of these functions as a linear combination 
of the others we would find by setting r = 1 that umo,..., Umm, Umis--->»Umm 
are linearly dependent in C(S). But this contradicts the known orthogonality of 
these functions, and the corollary follows. 

On the strength of Theorem 14-1 we are justified in introducing the formal series 
expansion of ἃ continuous function f on the unit sphere in terms of the umn, Unns 
even though we cannot as yet assert that this series converges in the mean to Κὶ 
Using the notation of Section 8-3 we therefore have 


οΌ Amo {4} 
f~ zu Ε: Umo + 2 (AmnUmn = Brana) ? (14-58) 
where Amo/2, Amn, Bmn are the generalized Fourier coefficients of f and are com- 
puted according to the formulas 


Amo _ f+ Umo_, 


eee (14-59) 


St *Umn 7 Umn 
Aa = == Bnn = : 
Umn " Umn Umn " Umn 


14-6 | ORTHOGONALITY OF THE SPHERICAL HARMONICS 571 


This series is known as the Laplace series expansion of f, and in the next section 
we shall prove that it does in fact converge in the mean to f. But first we evaluate 
the various inner products umn*Umn aNd Umn*Umn appearing in (14-59). The 
argument goes as follows. 

From (14-53) and (14-55) we have 


2a τ . 
Umn*Umn = | cos” n6 dé | sin?" +! 4 [P“ (cos ¢)]” de, 
0 0 


2x © 
Det Dy | sin? n6 d6 | sin?"t! ¢ [PS (cos y)]" de. 
0 0 
Thus if 


1 x 
oe | (1 — ΧΡ ΑἹ dx = / sin?” * » [Pi(cos ¢)]” de, 
—1 0 
we see that 


$(Umo*Umo) = tno; 


Umn* Umn = Umn*Umn = Ulin 


(14-60) 
and it remains to find the value of /,,, for given integers m andn(n < m). To 
this end we observe that 


1 
2 
ἘΞ 2 a 
Ino = [acs dx = ἼΣ, ΤῚ ΓῚ ([4-61) 


(see Section 11-3), and then use integration by parts to express Jinn41 in terms 
of Imn by setting 


w= ( — ΡΤ dv = Prt? dx 


in 
1 
κατα = Ι. ( -- χ Τρ ΤΠ dx. 
This gives 
| en - -- x?2yrtipetDpm)1 | 
1 
- LL -- ΧΡ TP -- 24 + 1) ΧΡΉ PY -- 2° Pm? dx 
1 
ΞΡ | [ᾳ — x?)PSt® (πᾳ - ΧΡΈΑ — x?y"P™ dx. 
But since 


( — x?)PRT? — 2(n + 1)xP@tY + [m(m + 1) — n(n + 1)P™ = 0 
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(see 14—57), it follows that 
1 
Inn = [m(m + 1) — na + 1)] | ( — x?)"[P@(x)P? dx 
Ξ᾿ 


= [m(m + 1) -- πίη + 1)Vmnn. 


Hence ; 
Insngi = (m — nym +n + LInn, (14-62) 


and an easy computation starting with the known value of J,,9 now yields 


_(m+tani 2. Ὁ 
bai i a ped O<n<m (14-63) 


(see Exercise 1). 
Finally, if this result is substituted in (14-60) and (14-59) we obtain the formulas 


2π τ 
" (2m + 1)(m — | | - n+l (n) 
Ann = Ἐπ} es a fg, 9) cos (10) sin” ¢ P,, (cos ¢) ἐφ dé, 


2π π 
_ (2m + Ἰ)ύη -- n)! | | 7 edits sia) 
B= GA 1 πὴ πο de f(g, 9) sin (n@) 51η  φ Pr’ (cos φ) ἀφ da, 


for all m and n. 


EXERCISES 


1. Verify Formula 14-63. 


2. Find the Laplace series expansion of the function 
f(¢, 0) = sin? g cos” ¢ sin 6 cos 6 


in the following two ways: 
(a) by direct application of the formulas in this section; 
(b) by writing 

f(y, 9) = 4cos? ¢ sin’ ¢ sin 26, 


and expressing cos” φ as a sum of terms of the form 


2 


d(cos ¢)2 P,,(cos φ). 


{ Hint: Note that 
1 d’(cos* φ) ᾿ 


2 ΞΟ 
Rare Bees d(cos ¢)2 


and then write cos* y as a Legendre series in cos ¢.] 
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3. Write cos? y cos? @ as a series of spherical harmonics. 


4. Prove that 


ee ee 2 
cos gsin gsin@cos θ 


P® (cos y) + τας P= (cos Ἵ sin 30 sin® φ 


-\|aa 


PS” (cos Ἵ sin θ sin ¢. 


2 »(Ὁ he a) 2k 
-ἰὰ (cos φ) — 575 Pa (cose) — & 


*5, (a) Expand the function 
f(y, 9) = ( — |cos g|)(1 + cos 26) 


in a series of spherical hamonics. 
(Ὁ) Find the solution of the boundary-value problem of Section 14-5 when ἡ (y, 8) 
is the function in (a). 

6. Solve Laplace’s equation in the spherical shell with inner radius a and outer radius 
ὃ (ὃ > a), given that u = 0 forr = ὁ, andu = f(y, 9) for r = a. [Warning: Since 
the point r = Ois not in the shell, both of the functions r” and r~™ + must be used.] 


7. (a) Use the results of the preceding exercise to find a solution for the shell problem 
when u = 0 forr = a,andu = gy, θ) forr = ὁ. 


(Ὁ) Solve the shell problem when u = f(y, 6) forr = α, ἀπά μ = gy, 6) forr = ὃ. 


*14-7 HARMONIC POLYNOMIALS AND THE BASIS THEOREM 


To complete the discussion of the spherical harmonics we must show that these 
functions generate the Euclidean space C(S). This result however is an easy corol- 
lary of the fact that every function in @(S) can be uniformly approximated by a 
finite linear combination of the tn, Umn, Where by this we mean that if we are 
given any function fin C(S), and any real number ε > 0, there exists a finite linear 
combination L(¢, 0) of the umn, Umn Such that 


If(e, 0) — Ly, | « ε 


for all0 < 9 < 4,0 < 6 < 2π. Indeed, the passage from such an approximation 
to the assertion that the umn, Umn generate C(S) is all but identical with the proof 
of Theorem 9-6 and will be left to the reader. With this understanding, we turn 
our attention to the following theorem. 


Theorem 14-2. Any continuous function on the surface of the unit sphere 
can be uniformly approximated by a finite linear combination of spherical 
harmonics. 


In broad outline, the proof consists of an argument to show that the spherical 
harmonics can be replaced by certain polynomials in x, y, z, which are then used 
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to construct the desired approximation. The basic properties of the polynomials 
in question are established in the following lemmas. 


Lemma 14-1. = For each non-negative integer m the functions r™umn and 
r"Umn are homogeneous polynomials of degree m when expressed in rectangu- 
lar coordinates.* 


Proof. We begin by rewriting μην and UV,» as polynomials in cos 8, sin 6, COs φ, 
sin φ, as follows. From the formula 


cos n@ + isinné = (cos @ + isin 6)” 


we see that cos né@ is the real part, and sin 7@ the imaginary part of the expansion 
of (cos 6 + isin 6)”. But, by the binomial theorem, 


(cos 6 + isin 6)” = cos" @ + a, cos” * (i sin 6) 
+ a, cos”? O(isin 6)? +--+ + (isin 6)”, 


where αἱ, a@2,... are constants whose specific values we can ignore. Since 
i* = —1, the real part of this expression is a sum of terms of the form 
n—k : Κ 
Cy COS 6 sin” 6, (14-64) 


- where c; is a constant, and k an even integer. Similarly, the imaginary part of 
(cos 0 + isin 6)” is a sum of terms of the same form with k odd. 

_ Next, we observe that the nth derivative of the Legendre polynomial P,,(x) 
is a polynomial of degree m — n, composed of terms of the form djx”—"—?’, d; 
a constant, j a non-negative integer. (Recall that the degree of every term in Pm(x) 
is either even or odd according as m is even or odd.) Hence P™ (cos ¢) is a poly- 
nomial in cos φ, each of whose terms is of the form 


d; cos”—"—*! , (14-65) 


Combined with (14-64), this implies that each of the spherical harmonics ump, 
Umn can be decomposed into a sum with individual entries 


m—n—2j 


Ojk cos” —* 9 sin® θ sin” ¢ cos φ 


* A polynomial p(x, y, z) is homogeneous of degree m if and only if it can be written 
in the form 
| j_k 
p(x, Ys Ζ) πΞ » CijhX YZ ᾽ 
itjtk=m 


where the cj, are real numbers. Thus x” — 2y? + xz and 2xy — 3yz 4+ z? are homo- 
geneous of degree two, while x?y — 4xyz — 323 is homogeneous of degree three. The 
reader should note that according to this definition the zero polynomial is homogeneous 


of every degree. 
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for suitable constants a;, and integers j and k. Thus the functions ru,,, and 


rUmn have a similar decomposition, with a typical term appearing as 
αν" cos”—* 6 sin® θ sin” y cos™—"—*! 


= ogy 27, Ὁ cos”—* 6 sin” " φ] γ᾿ sin® θ sin® φ] ν΄ 5 Τ᾽ ρος" 27 6]. 


; (14-66) 
To complete the proof we recall that 


x = rcos@sin φ, y=rsiné@sing, Z = rcosg. 
Thus when converted to rectangular coordinates, (14-66) becomes 
2 2 2.7. n—k k m—n—2j 
aje(x” + yo + yxy, 
and 1s obviously a polynomial in x, y, z, each of whose terms is of degree m. J 


For our purposes this lemma is important because it allows us to assert that the 
equation 
a°u δι. δι 


ax2 ἱ aye t az2 Ὁ ne 


has polynomial solutions which are homogeneous of degree m for each integer 
m ΣΟ. Any such solution of Laplace’s equation is called a homogeneous har- 
monic polynomial of degree m, and the linearity of (14-67) implies that the set 3C,, 
of all homogeneous harmonic polynomials of degree m is a real vector space. 
Moreover, it follows from Corollary 14-1 that the 2m + 1 functions 


m mm m m 
r UmO> r Um1s5 ve eg r Umns γε oe 8 9 r Umn (14-68) 


are linearly independent in #,, when expressed in rectangular coordinates. We 
now propose to show that they are actually a basis for 3C,, by proving 


Lemma 14-2. For each integer m, the vector space ®» is of dimension 
2m + 1. 


Proof. This is clearly true if m < 2. For m > 2 let 


u(x, y, 2) = De Cy jex' yi” (14-69) 
ititk=m 
be an arbitrary homogeneous polynomial of degree m. Then 
au, au, ou 
0x2 Oy? Oz? 


is homogeneous of degree m — 2, and hence is a sum of terms of the form 
dapyx*y'z", where dagy is a constant and 


a+ B+ Y= m — 2. 
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Moreover, if for fixed values of a, 8, Y we add the coefficients of x“y°z” appearing 
in the derivatives 07u/dx”, 07u/dy”, 07u/dz”, we find that 


depy = (a + 2)(a + I)ca+e,6,7 + (8 + 2)(β + I)Ca,p+2,7 
+ (Y + 2)07 + 1)€a,8,742 (14-70) 


(see Exercise 1). 
Now suppose that u(x, y, z) is harmonic. Then each of the dygy appearing as 
coefficients in the polynomial 


ax? dy? az? 


must be zero, and it follows that 


(Y + 2)07 + 1)Ca,8,7-+2 = —(a+ 2)(a + 1 )Ca+2,8,7 
— (8B + 2)(8 + 1)Ca,g42,7- (14-71) 


In other words, a homogeneous polynomial of degree m in x, y, z is harmonic if 
and only if its coefficients satisfy (14-71) witha + B + Y =m — 2. 

To interpret this result in terms of the vector space 3C,,, we introduce the fol- 
lowing triangular array formed from the coefficients of (14-70): 


Cm—1,0,1 Cm—1,1,0 


Cm—2, 2,0 


7 
“ Cm—2,0,2 Cm—2,1,1 


Co,m,0 


Co,m—1,1 


a sn li 


If this array is examined closely, it soon becomes apparent that the entires along 
the two enclosed diagonals on the upper right determine, via (14-71), all of the 
other coefficients in the triangle. Indeed, the coefficients along the uppermost 
diagonal determine those along the third, which in turn determine those along 
the fifth, etc., while the coefficients along the second diagonal determine, succes- 
sively, those along the fourth, sixth, and so forth. Thus two harmonic polynomials 
in 3Cm are identical if and only if the 2m + 1 coefficients appearing along the upper 
diagonals of their coefficient triangles are identical. 

To conclude the proof of the lemma we now let Q;, 0 < k < m, denote the 
polynomial in 3C,, determined by setting Cm—z,r,0 = 1 and all other “special” 
coefficients Cm—k.B.7) Cm—k—1.8,7 Zero, and let Ry, 1 < k < μι, denote the poly- 
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nomial in 3C,, obtained by setting ¢m—x,%—1,1 = 1 and all other special coefficients 
zero. (The coefficient triangles for these polynomials are those which have exactly 
one nonzero entry on the two uppermost diagonals, that entry being 1.) The 
above result implies that the 2m + 1 polynomials Qo, Q1,..., Om, Ri,..-, Rm 
are linearly independent and span ὅ;,, and we are done. ἢ 


EXAMPLE 1. The most general homogeneous polynomial of degree 3 in x, y, 
and z is a sum of ten terms 


τὰ 
ΟΣ ΖΞ Σ, ΦΑΎΣ, 
i+jfk=3 


and has the following array as coefficient triangle: 


C210 


Cool 


C102 C111 C120 


C003 Co12 Co21 C030 


In this case an easy computation using (14-71) shows that the particular homoge- 
neous harmonic polynomials constructed above are 


Thus 
Oo = x? — 3xz?, Ry, = x?z — 423, 
Q, = x*y — yz’, Ro = xyz, 
Oo = —xz7 + xy?, R3 = --ἰἰΖῇ 4+ yz, 
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and the preceding lemma implies that these polynomials are a basis for the space 
3C3. Using them we can easily construct al] homogeneous harmonic polynomials 
of degree 3 in x, y, z. 

With these results in hand we are now in a position to prove that every con- 
tinuous function f(y, 6) defined on the surface of the unit sphere can be uniformly 
approximated by a linear combination of spherical harmonics (Theorem 14-2). 
Once again we use the Weierstrass approximation theorem, which in this context 
asserts that every continuous function on the closed unit sphere r <1 can be 
uniformly approximated by polynomials.* Thus, if € > 0 is given there exists a 
polynomial p(x, y, z) such that 


In f(y, 0) — p(x, y, 2) < € 


throughout the solid sphere. In particular, we note that this approximation is 
also valid on the surface S of the unit sphere where r = x? + y? + z? = 1. 
Now suppose p(x, y, z) is of degree γι. Then if we restrict our attention to the 
surface S we can use the identity z? = 1 — (x? + y?) to write p(x, y, z) asa 
linear combination of the monomials 


xtyiz* kk <1, itjtk<m. (14-72) 


Thus, on S, p(x, y, z) may be viewed as a member of the vector space U consisting 
of all polynomials in x, y, z which are linear combinations of the above monomials. 
But these monomials are certainly linearly independent in Ὁ, and therefore are a 
basis for ©. Moreover, an easy counting argument shows that for each fixed value 
of a, 0 < a < m, there are exactly 2a + 1 monomials of type (14-72) with 
i+ j+k =a. Hence, since 


S* Qa + 1) = (m + 1)" 
a=0 


we have dim 0 = (m + 1)?. 
On the other hand, for each fixed value of a, the 2a + 1 functions 


a a [a4 a 
ah PY ee ig) ee γι ως Dae (14-73) 


are homogeneous polynomials of degree a when expressed in rectangular co- 
ordinates (Lemma 14-1). In addition, when restricted to S these polynomials 
belong to the vector space U, and are linearly independent in 0. Thus, if we let 
a run from 0 to m we obtain in this way (m + 1)? linearly independent poly- 
nomials in U, and therefore have a basis for U. It now follows that on the surface 
of the sphere p(x, y, z) may be written as a linear combination of these polynomials. 
And with this, Theorem 14-2 is proved, since when r = 1 the various functions in 
(14-73) are none other than the spherical harmonics of order a. 


* More generally, the three-dimensional version of the Weierstrass approximation 
theorem states that every continuous function in a closed bounded region of three-space 
can be uniformly approximated by polynomials. 
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EXERCISES 


1. Verify Formula (14-70). 

2. (a) Use the technique of Example 1 to find a basis for the space C2 of homogeneous 
harmonic polynomials of degree 2. 
(Ὁ) Determine which of the following polynomials belong to the space 3C2: 


(x — z(x ty +2), x? + y?, 2x? + y? — xy 4+ 222, 
x(y — 22) + γα — 22) + zx — y), γὺΟ — 2x) — x + 2). 


3. Verify that the homogeneous polynomial 
x3 — xz? — 2xy? 


is harmonic, and express it as a linear combination of the basis for 3C3 found in 
Example 1. 
4. Let Ro = xyz (see Example 1). Prove that 


R2 = τ 3,2. 


5. Express each of the functions 
r3u3 n (n = 0, 1, 2; 3), γϑυ3,ν (n = hs 2, 3) 


in terms of x, y, Ζ. 


6. Let U, denote the vector space of all harmonic polynomials of degree n (n > 2) in 


x and y, and let each of the polynomials in U,, be written in standard form as 


n 


P(x, y) = ΣΝ διε ἀχ ὟΝ 
κ--ὦ 


(a) Prove that dim Ἢ, = 2, and that the real and imaginary parts of (x + iy)” 
form a basis for Un. 

(b) Derive a formula for the coefficients of the polynomials in U, analogous to 
(14-70), and use it to prove that for each non-negative integer j with k + 2) < a, 


kia — k)! 


. . = — 7 a  -ς-ς-.- 
Ο,.--ἰ(ἀ-22),1.-Ε2] ( 1) (k Ἔ 2 ἢ \(n sg ταν 2} Cnr—k,k- 


7. Use the result of Exercise 6(b) to find the value of each coefficient in P(x, y) in 
terms of the coefficient c,,9 OF Cn—1,1- 


8. A nonzero homogeneous harmonic polynomial in x and y is divisible by xy. Prove 
that the degree of the polynomial is even. (See Exercises 6 and 7.) 


9. (a) Find the homogeneous harmonic polynomial of degree 6 in x and y which 
contains the term x® but no term in χῦγ. 
(Ὁ) Repeat (a) for the polynomial which contains the term χῦν but no term in x°®. 


(c) Find the homogeneous harmonic polynomial of degree 6 in x and y which 
contains the terms x® + 6x°y. 
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10. 


11. 


12. 


13. 


14. 


Ἐ15. 
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Prove that the number of terms with nonzero coefficients in a homogeneous har- 
monic polynomial in x and y of degree n > 2 is n/2, (n/2) + 1, orn + 1ifn 
is even, or (2 + 1)/2 orn + 1 if nis odd. (See Exercises 6 and 7.) 


Use the technique introduced in this section to find a basis for the space 3C4. 


(a) Prove that if f(x, y, z) is a harmonic function in a sphere (or in all of three- 
space), then so is the function g(x, y, z) = f(—x, y, 2). Use this result to show that 
for fixed values of any two variables, the even and odd parts of f(x, y, z) with 
respect to the third variable are harmonic whenever / is harmonic. 

(Ὁ) Use the above result to prove that whenever a polynomial in 3C2 is even (or odd) 
with respect to a particular variable, it is a linear combination of those members 
of the standard basis for 3C2 which are even (or odd) with respect to that variable. 
(c) Show that a polynomial in 3C2 cannot be odd with respect to each of the three 
variables. 


(a) Express each of the functions 
r2uon (n= 0,1,2), rven (n = 1, 2) 


in terms of the basis for 3C2 found in Exercise 2(a). [Hint: Use the properties noted 
in Exercise 12.] 

(b) Use the result in (a) to express each of the basis polynomials found in Exercise 
2(a) in terms of the basis consisting of r2u2.n (σι = 0,1, 2) and r?v2,n ΟἹ = 1, 2). 

Let P(x, y, z) be an arbitrary polynomial in 3C3. Prove that 0P/dx belongs to Ke, 
and express this polynomial as a linear combination of the basis for 3C2 found in 
Exercise 2(a). 


Prove that the number of nonzero terms in P,,(x1, X2,..., Xx), the general homo- 
geneous polynomial of degree m > 1ink > 1 variables, is 


acd: 
k—1 


m 
Pm(X1, X2,.++5Xk) = a Xi, On (αι, Χα,. .. XE); 
j=0 


[Hint: For k > 1 write 


where each Q,,_; is a homogeneous polynomial of degree m — j in the variables 
X1,..-,Xt—1. Then use induction on k, and the formulas 


i i ἱ-Ε 1 ᾿ . 
= iO < Pe P=, 
(γ) {1} ea ee 


ys desi - (151). δον Stee 
p p+i1 


i=0 
ij} Ni- if #BE- DE SJ 


Recall that 


*16. 


517, 


*18. 


19. 
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(a) Let m be a positive integer, and set 
m m γι 
P04 Xo sag ke) = ) c(my, mo,..., ΜΙΚ)ΧΙ ΧΩ"... XE”, 


where the c(m1, mo,..., m,) are constants, and the summation extends over all 
non-negative integral values of m1, mo,...,m, for which m,; + mz2+°:- 
+ m, = m. Prove that P,, is harmonic (i.e., is a solution of the partial differ- 
ential equation >-f_, 02u/0x? = 0) if and only if 


c(m, oe ey Me—1, Mk Ἔ 2) 


χα (mi + 2)(σι; + 1) 
—— DoD c(m,..., Mi-1, mi + 2, mii1,..., Mx). 
(b) Let Qmn(x1,...,X%—1) be the polynomial consisting of those terms of 
Pm(x1,...,5 Xx) in which the variable x; is absent, let x,Qm—1(x1,..., Xz—1) be 
the polynomial in which x; appears to the first degree, and suppose that P,, is har- 
monic. Prove that the coefficients of P,, are uniquely determined by the coefficients 
of O,, and Q,,_1. 


Let X denote the set of all homogeneous harmonic polynomials of degree m > 1 
in k > 2 variables x1,..., x; with the property that each polynomial in X con- 
tains exactly one term (and that with coefficient 1) for which the exponent of x; is 
Jess than 2. Prove that X is a basis for the space 3C,,,, of all homogeneous harmonic 
polynomials of degree m in k variables, and determine the dimension of this space. 


Can the following assertion be deduced from the results of this section? 
Any harmonic function in the closed unit sphere r < 1 can be uniformly approxi- 
mated by harmonic polynomials. 

Why? 


Use Theorem 14-2 to prove that the spherical harmonics are a basis for the Euclidean 
space C(S). 


15 


boundary-value problems 


involving bessel functions* 


15-1 INTRODUCTION 


After the succession of examples in the preceding chapters the student has probably 
come to the conclusion that the techniques we have developed are adequate to 
- solve any boundary-value problem involving the wave equation, heat equation, or 
Laplace’s equation, at least when the underlying region and boundary conditions 
are reasonably simple. This, however, is false, as can be seen by considering 
Laplace’s equation in cylindrical coordinates (r, 6,z), where x = rcos6, y = 
rsin 0, z = z. For then 
07u 07u 


2 
oe 4 oe 


ax2 ᾿ dy2 | az2 0 


becomes 
07u 1 Ou 1 δι O7u 
ara + > ar + ΤΣ age T act 


or? r or r2 062 aa . GS-1 


and if we attempt to find solutions of (15-1) which are independent of 6 and have 
the form u(r, z) = R(r)Z(z), we see that R and Z must satisfy the equations 


Z = )?7Z = 0 (15-2) 
and 
r?R” + rR’ + \?77R = 0, r > 0. (15-3) 


(The motive behind writing the constant as —d? will become clear later.) 
Although the first of these equations can be handled with ease, the second 
causes trouble because its leading coefficient vanishes at r = Ὁ. Here the imagina- 
tive student might suggest using the power series method to solve (15-3) about 
r = a,a > O, since its coefficients are analytic whenever r ~ 0. Unfortunately, 
this will not do, for the simple reason that the resulting series need not converge 
outside the interval (0, 2a), whereas we seek solutions valid for all r > Ὁ. (See 
Theorem 6-4.) Clearly, then, if we are to make any progress in solving this prob- 


* The following discussion assumes a knowledge of the material in Chapter 6. 
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lem, or others of the same ilk, we must devise a method for studying the solutions 
of a linear differential equation near points where its leading coefficient vanishes. 
This is precisely what will be done in the sections which follow, where we introduce 
the celebrated method of Frobenius generalizing the power series technique to a 
large number of non-normal linear differential equations. Once this has been done, 
we shall use the technique in question to study the solutions of Bessel’s equation 
and the last important class of elementary boundary-value problems. 


EXERCISES 


1. Use the coordinate transformations given above to show that Laplace’s equation 
becomes 
du, 1du, 1 du, ou 
Or2 r or r2 06@2 022 


in cylindrical coordinates. 
2. Assume that Laplace’s equation in cylindrical coordinates has a solution of the form 
u(r, z) = R(r)Z(z), and show that R and Z must satisfy Eqs. (15-2) and (15-3). 
3. Show that the equation 
r2R" + rR’ + 2r2R = 0 


can be transformed into Bessel’s equation of order zero by an appropriate change of 
variable. (See Section 6-2.) 


15-2 REGULAR SINGULAR POINTS 


Let 
P(x)y” + qx)’ + rQx)y = 0 (15-4) 


be a second-order homogeneous linear differential equation whose coefficients are 
analytic in an open interval J of the x-axis, and suppose that p(xo) = 0 for some 
Xo in J. (Such a point is said to be a singular point for the equation.) Then, the 
assumed analyticity of the coefficients of (15-4) implies that the function p has a 
power series expansion , 


io ¢) 


p(x) ai Σ᾽, αμ(χ Ν x0)" 


k=0 


valid in some interval about the point x9. Moreover, since p(xo9) = 0, the leading 
coefficient in this series must vanish, and there exists a positive integer m such that 


oo 


P(x) = > a(x — xo)" = (x — x0)” ax -- xo) 


k=m k=m 


(x — xo)"pi(x), 
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where p, is analytic at xo, and p;(xo) ¥ 0. We now divide the coefficients of 
(15-4) by p,; to obtain an equation of the form 


(x — xXo)"V" + aid)y + nidy = 0, (15-5) 


whose coefficients are still analytic at x9, and which is equivalent to (15-4) in an 
interval about that point. Thus, when studying the solutions of a second-order 
homogeneous linear differential equation about a singular point x9 we can always 
write the equation in this special form. 

It turns out that the behavior of the solutions of (15-5) near xg is strongly de- 
pendent upon the exponent m and the value of 4) at xo, and leads to a classification 
of singular points as “‘regular” and “‘irregular’’ according to the following definition. 


Definition 15-1. A point x9 is said to be a regular singular point for a 
second-order homogeneous linear differential equation if and only if the 
equation can be written in the form 


(x — Xo)?y” + (x — χο)φαὺ)ν' + τὴν = 0, (15-6) 


where g and γ are analytic at x9. All other singular points are said to be 
irregular. 


Thus, among the singular points for the equation 
x2(x + DP — Dy” + xy’ — 2ν = 0,7 (15-7) 
those at 0 and 1 are regular since (15-7) may be rewritten 


2 


τς οὖς οὖ οὐ ςὴ 
ατ θα -) ~ &+D9@-—D ᾿ 


x? yl + 
and 


2.0 ae 5 ie eee ἐπα = 
OD" + ee Ip” ~ eG 1p? = 9 


about x = 0 and x = 1, respectively. On the other hand, —1 is an irregular 
singular point for (15-7) because the coefficients of y and y’ in 


x+ 1 2 0 


πε τ πε  2er le. by” 


are undefined atx = —l1. 

As the terminology suggests, regular singular points are relatively easy to handle. 
In fact, with appropriate modification, the method of undetermined coefficients 
introduced in Chapter 6 can be used to obtain a basis for the solution space of 
any second-order linear differential equation about a regular singular point. Not 
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so when xX, is an irregular singular point. Here the situation is far more com- 
plicated, and it is not difficult to exhibit equations which fail to have series solu- 
tions of any form about such a point (see Exercise 11 below). Fortunately, all of 
the boundary-value problems we shall encounter involve equations whose only 
singularities are regular, and hence we shall have no more to say about irregular 
singular points. 

Finally, for simplicity, we shall limit the following discussion to singularities at 
the origin, in which case (15-6) becomes 


x?y" + xq(x)y’ + roy = 0. 


The reader should appreciate that this involves no loss of generality since the 
change of variable u = x — Xo shifts a singularity from xo to 0. 


EXERCISES 


Find and classify all of the singular points for the equations in Exercises 1 through 10. 
1. x3(x?2 — 1)ν" — x(x + Dy’ — α — Dy = 0 

. Bx — 2)2χγ"' + xy’ —-y = 0 

. (xt — ly” + xy’ = 0 

. α + 14 — 1)2»" — @+ 16 -- Dy’ + y = 0 

x3(x — Iy” + ἃ — Dy’ + 2xy = 0 

x3(x + 1)2ν" - y = 0 

. xl — χὴν" + d — 5x)y’ — ἄν = 0 


. Legendre’s equation: 


(1 — ἢν" — 2xy’ + AA + Dy = 0 


9. Bessel’s equation: 
xy!’ + xy’ + (x? — d*)y = 0 
10. Laguerre’s equation: 
xy’ + U1 — x)’ + Ay = 0 
11. Prove that the equation 
xy” + y = 0 


has no nontrivial series solution of the form 


i? a] 
kK 
Σ aX ἐν 
k=0 


for any real number ν. 
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15-3 EXAMPLES OF SOLUTIONS ABOUT A REGULAR SINGULAR POINT 


The simplest example of a second-order equation with a regular singular point at 
the origin is the Euler equation 


x7y"’ + axy’ + by = 0, 


a and b (real) constants, studied in Chapter 4. At that time we proved that the 
solution space of this equation is spanned by a pair of functions y, and yp» con- 
structed from the roots v1, v2 of the equation 


vy -- 1) ἂν Ὁ ὃ 0, 


as follows. If v, ¥ vo, 


Ι 


yilx) = [χ}΄1, γ20.) = [x|’2; 


ifvy = νυ = ν, 
γι) = [xP, yo(x) = |x|’ In |x|* 


Save for the fact that y, and y2 here appear in closed form, these expressions are 
typical of the solutions of second-order homogeneous linear differential equations 
with a regular singular point at the origin. Indeed, we shall find that about x = 0 
the solution space of such an equation is always spanned by a pair of functions 
which depend upon the roots of a polynomial equation of degree two, that these 
functions involve powers of |x|, and under certain circumstances a logarithmic 
term as well. The following example will illustrate these remarks, and introduce 
the technique which is used to handle the general case. 


EXAMPLE. Find the general solution of 
x*y"’ + x(x — $)y’ + ay = 0 (15-8) 


on each of the intervals (0, οὐ) and (— οὐ, 0). . 
We begin by considering the interval x > 0, where we seek a solution of the 
form 


οο 


y(x) = x’ > a,x" = » a,x’, (15-9) 
k=0 


k=0 


witha, τέ 0, and v arbitrary. (This particular guess as to the form of y is motivated 
by the results obtained for the Euler equation, and from that point of view is not 


* Recall that when z is complex, |x|* = e7!"!*!. Hence if v1 =a + Gi, ve = a — Bi, 
then 
yi(x) = |x|@sin @In |x|), v2) = [x|* cos G In [χ}). 
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unreasonable.) We then have 


0 


y'(x) = Do ( + vyagx"?™, 


k=0 


[oa] 


γ"0) = Σὺ ὦ + yk + — 1)αρχ PP, 


k=0 
and substitution in (15-8) yields 


Σ; (k + ν)ὰ + ν -- Ἰ)αρχῖ τ" + > (k + v)ayx*?+} 


be py Ve. 
5 dy (A + ν)αιχ + 5 Σ, ἄχ = 0. 


But since 


ie a) 


a (k + ν)αρχ tt! = > (kee Dax τ" 
k=0 


k=1 


the above expression may be rewritten 


ie 2) 


[ν(ν = 1) = ἣν + Ζ]αρχ' + Σ [(k + v)(k Ἔν — 1) τεῦ 4(k a ν) 4. La,xt” 


k=1 


+ Σ; (k --ἰσν -- 1)ay_yx**’ = 0. 


k=1 


Thus if (15-9) is to be a solution of the given equation we must have 


vy — 1) -- ἐν + § = 0, (15-10) 

and 
(A+ ν)χκ -Ὁ}Ὸςν -- Ἰ) -- ξ(Κ +7~4+ Ζ]αρ -Ἑ (Κ -Ἐν -- Day =0, k> 1. 
(15-11) 


(Recall that we assumed ay ~ 0.) 
Equation (15-10) determines the admissible values of v for this problem as ὦ 
and 1, and is known as the indicial equation associated with (15-8). We now set 


Iv) = vv — 1) — ἄν + ὁ, 
and rewrite (15-10) and (15-11) as 


Iv) = 0, (15-12) 


and 
ik + via, + (kK +0 -- Dag_, = 0, k= 1. (15-13) 
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In particular, when vy = 4, I(k + v) = k(k — 2), and (15-13) becomes 


] 

Q= - 1 ἘΞ 
Thus 
a; = --α-ἀὀρ; 
ao 

ag = 51 

ao 
= 9.555 31? 


ay = (-1' τ. 


Similarly, when ν = 1, 


2 
ay = — w+ 1 Ak—1s 
and 
a, = —$ao, 
92 

ag 5.3 ao, 

93 
re 75630 8 
" 

— er ᾿Ξ ee Ἐπ ees 

te oe ἼΩΝ = ἢ τ Ἔτη 


We now set ay = 1 and substitute the above values in (15-9) to obtain the two 
series 


00 k 
γιοῦ = x? (E> (15-14) 
k=0 ° 
and 
ss (2x)" 
yo(x) = ea) GEE Ok = 12579" (15-15) 


each of which formally satisfies (15-8) on the interval (0, oo). 

Thus to complete the argument it remains to show that these series converge for 
all x > 0, and that the functions they define are linearly independent in C(O, ~). 
Leaving the latter point as an exercise, we establish convergence by using the ratio 


test with 
oe se 
(k + 1)! k! 


Pi. = 
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for the first series, and 


ght yk+2 ἡ gh kt 2|x| 
2, ἢ. τ) ORI 1). 5.) Oe 3 


for the second. Then 


lim p; = lim pg = 0 
ko 


ko 


for all x, and the series do converge as desired. Thus the general solution of 
(15-8) on (0, «) is 


V(X) = €1y1(X) + Coyo(x), 


where c, and Cg are arbitrary constants. 

Finally, to remove the restriction on the interval we observe that the above 
argument goes through without change if x’ is replaced by |x|’ in (15-9); i.e., by 
(—x)’ for x < 0. Thus the general solution of (15-8) on any interval not contain- 
ing the origin is 


7 00 xh 00 (2x)* 
y(x) = ¢y|x|" du 1 .Ἐ call 2. Ὁ" παι 


EXERCISES 


1. Prove that the functions y; and ye defined by (15-14) and (15-15) are linearly inde- 
pendent in C(0, ©). [Hint: Consider the behavior of cyyi(x) + coye(x) as x — 0.] 


2. The equation 
x?y"’ + x(x — ὃν + dy = 0 
has solutions which are defined for a// x. What are they? 
3. Find the indicial equation associated with the regular singular point at x = 0 for 
each of the following equations. 
(a) x*y" + xy’ —y = 0 
(Ὁ) x*y"” — 2x(x + Dy’ + (ἃ -- Dy = 0 
(c) x*y” — 2xy’ + y = 0 
(d) xy" — xy’ + (x? — d*)y = 0, daconstant 
(6) xy’ + A — xy’ + Ay = 0, Aaconstant 


4, Prove that the indicial equation associated with 


. x?y" + xq(x)y’  τοὺν = 0 
1S 


νίν -- 1) + g@O)v + r(0) = 0 


whenever g and r are polynomials. 


590 BOUNDARY-VALUE PROBLEMS INVOLVING BESSEL FUNCTIONS | CHAP. 15 


5. Find the indicial equation associated with each of the regular singular points x = 1 
and x = —1 for Legendre’s equation 


(1 — x?)yp"” — 2xy’ + AA + Dy = 0. 


Use the method introduced in this section to find two linearly independent solutions 
of the equations in Exercises 6 through 10. In each case verify that the solutions obtained 
converge whenever |x| > 0, and that they are linearly independent in C(0, ©) and 


6. 2x7y" + xy’ —y =0 7. 9x2y" + 3x(x + 3)ν' — [ἀκ + Ly = 0 


1 
ὃ. xy’ + as γ —y=0 9. 8x2y" — 2x(x — ly’ + & + ly = 0 


10. 4x2y” + x(2x — 7)y’ + 6y = 0 
11. Use the method of this section to prove that Laguerre’s equation of order Δ, 
ay =a) tb ay = 0, 


has a solution which is analytic for all x, and which reduces to a polynomial when 
\ is a non-negative integer. 


15-4 SOLUTIONS ABOUT A REGULAR SINGULAR POINT: 
THE GENERAL CASE 


In this section we shall indicate how the technique introduced above can always 
be used to find at least one solution of 


x*y" + xq(x)y’ + ry = 0 (15-16) 


about the origin whenever g and r are analytic at x = 0. We again begin by 
letting x be positive, in which case we seek a solution of the form 


γα) = xX >> ax” (15-17) 
k=0 
with ag τέ 0. Then 


yx) = x S&F vyagx*, 
k=0 


yx) = x > (A+ vykK +7 -- 1)a,x"—?, 
k=0 


and substitution in (15-16) yields 


οΌ 


Σ (k + vk + ν -- 1)ayx* + q(x) Σ, (Κ + νγ)αμρχῖ + r(x) 3 a,x* = 0. 
k=0 


k=0 k=0 


(15-18) 
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But since g and r are analytic at x = 0, we can write 
gx) = Do φιχ, το) = Σ᾿) rex’, (15-19) 
k=0 k=0 


where both series converge in an interval |x| < Ro, Ro > 0, centered at x = 0. 
Substituting (15-19) in (15-18), we have 


> (K+ vk + vy — 1)a;,x* + (5 (k + Naw") ax) 
k=0 a: 


k=0 
+. (Σ ax") 2 nex) =), 
k=0 k=0 


and if we now carry out the indicated multiplications according to the formula 
given in Section 6-6 we obtain 


00 k k 
D G + ν) Ἐν — Ijaz, + ἊΝ () + ν)α;ᾳμ.; + δ aire-s| x” = 0. 
k=0 j=0 


j=0 


Hence (15-17) will formally satisfy the given differential equation in the interval 
0 < x < Ro if and only if 


k 
(Κ + vk + ν — Nae + DOIG + ν)ι.» + για; = 0 (15-20) 


j=0 
for all k > 0. 
When k = 0, (15-20) reduces to 
vv μας: 1) +- ov + ro = 0 (15-21) 
(recall that ag τέ 0), and when k > 1, (15-20) reduces to 


k-—1 

[(ἀ + vk -Ἑ ν — 1+ aolk +») + relax + DOIG + vei + τι ἤα; = 0. 
j=0 

(15-22) 


The first of these relations is known as the indicial equation associated with (15-16), 
and its roots, which determine the admissible values of v in (15-17), are called 
the characteristic exponents of that equation. We direct the reader’s attention to 
the fact that since 40 and rg are, respectively, the constant terms in the series 
expansions of g and r, (15-21) may be rewritten 


vw — 1) 4+ gO + γ(0) = 0 (15-23) 


(cf. Eq. (15-19)). Thus when g and r have been explicitly given, the indicial equa- 
tion can be obtained directly from (15-16) without undertaking the above 
computations. 
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To continue, we now set 
Iv) = vv — 1) + gov + ro, 


and let vy; and vz denote the roots of the equation J(v) = 0. Moreover, for con- 
venience we suppose that v; and νῷ have been labeled in such a way that 
Re (v;) > Re (vg).* Then, when vy = ν,, (15-22) becomes 


k—1 
ΚΑ + viaw + SO IG + νιλάκ-; + στρ ῆα; = 0, (15-24) 


j=0 


and, by the way in which ν; was chosen, we know that J(k + v,) ¥ Ofork = 1, 


2,.... Hence (15-24) can be solved for a; to yield the recurrence relation 
Be ea, Σ, [G+ νι})4ι--) + re—jlaj, K 21, (45-25) 


which serves to determine all of the a, from k = 1 onward in terms of ag. And 
with this we have succeeded in producing a formal solution of Eq. (15-16), valid 
in the intervalO < x < Ro. Moreover, if x” is replaced by |x|’ throughout these 
computations, this result obviously holds in the interval —Ry < x < 0 as well. 
Finally, it can be shown that the series obtained in this way always converges if 
0 < |x| < Ro.f Hence the function 


y(x) = [xl Σὺ apex" (15-26) 
k=0 


with ap arbitrary and the a, given by (15-25) is a solution of (15-16) when 
0 < |x| < Ro. 

To complete the discussion we must now find a second solution of (15-16), 
linearly independent of the one just obtained. To this end we attempt to repeat 
the above argument using the second root v2 of the indicial equation. Of course, 
if v; = V2 we get nothing new. However, if ν! τέ v2, (15-24) becomes 


k—1 
Ik + va)az + DOIG + v2)qe—i + rela; = 0, (15-27) 


j=0 


which can again be solved for a, provided I(k + v2) # 0 for allk > 1. But 
when k > QO, 
I(k + v2) = 0 


* By Re(v) we understand the real part of the complex number v. Thus ifvy = a + Bi, 
Re(v) = a. The real part of a real number is, of course, the number itself. 

+ A proof of this fact can be found in the book by Coddington cited in the 
bibliography. 
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if and only if k + vo = v1; ie., if and only if vy; — ve = k. [Recall that 
Re (v1) > Re (v2).] Thus the above method will produce a second solution of 
(15-16) of the form 


y(x) = [xf? D> ax", ao ¥ 0, (15-28) 
k=0 


valid for 0 < |x| < Ro whenever the roots of the indicial equation I(v) = Ὁ do not 
differ by an integer. In this case it is easy to show that the (particular) solutions 
γι and y» obtained by setting ag = 1 in (15-26) and (15-28) are linearly inde- 
pendent, and hence that the general solution of (15-16) in a neighborhood of the 
origin is 

V(x) = Ciyi(X) + Coye(x), 


where c, and cg are arbitrary constants. This, for instance, is precisely what 
happened in the example given in the preceding section. 


EXERCISES 
Find two linearly independent solutions about x = 0 for each of the following equations, 
and state for what values of x these solutions are valid. 

1. x(x — Dy” + & — 2)y’ — 4y = 0 

2. 2x2y" + 5xy’ — 2y = 0 

3. 8x(x + Dy” — 8’ + y = 0 


4. 2χγ'" + 3y τον 


6. 2x2y"” + x(x -- 1)y’ 2» = 0 
7. 4x2(x + Dy” + xBx -— Ly’ + y = 0 
8. x2y” + xy’ + (x? — ὃν = 0 
9. 3x7y"” + xy’ — (1 + xy 
x(7x + 1) 1 


_ 2x2y"! ee χσνὴς. τ συμ ἢ = 
10. 2x*y" τ iy ee Sag? 


0 


Compute the values of the coefficients a1, a2, a3 in the series solutions of each of the 
following equations. (Assume ag = 1.) 


11. χἕν" + x(x + Dy’ + y = 0 
12. 16x?y"” — 4x(x? — 4y’ — y = 0 
13. x2(x? — 1)y” — xy’ — 2y = 0 
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14. 8x2(x — 2)γ" + 2xy’ — (cosx)y = 0 
15. xy” + xety’ + y = 0 
16. Let γι and y2 denote the functions obtained from (15-26) and (15-28) by setting 


ag = 1. Prove that γι and y2 are linearly. independent in C(0, Ro) and C(— Ro, 0). 
[Hint: See Exercise 1, Section 15-3.] 


*17. (a) Show that x = 1 is a regular singular point for Legendre’s equation 
(1 — x?)y” — 2xy’ + A 4+ Dy = 0, 


and find a solution about this point of the form 
γα) = |x - 1 Σ᾽ αα ἜΝ 6 yi 
k=0 


(Ὁ) Determine the values of x for which this solution 15 valid. 


15-5 SOLUTIONS ABOUT A REGULAR SINGULAR POINT: 
THE EXCEPTIONAL CASES 


To complete our study of solutions about regular singular points it remains to 
consider the case where the roots vj, v2 of the equation J(v) = 0 differ by an in- 
teger. Our experience with the Euler equation suggests that a solution involving 
a logarithmic term should arise when v; = vo, and, as we shall see, this can also 
happen when vy; σέ vg. The following theorem gives a complete description of the 
situation, both in the general case treated above, and in each of the exceptional 
cases. 


Theorem 15-1. Let 

x*y” + xg(x)y’ + rey = 0 (15-29) 
be a second-order homogeneous linear differential equation whose coefficients 
are analytic in the interval |x| < Ro (Ro > 0), let v1 and νὰ be the roots 


of the indicial equation 


vv — 1) + gO + r(0) = 0, 


and suppose that νι! and να have been labeled so that Re (ν1) = Re (2). 
Then (15-29) has two linearly independent solutions γι and yo, valid for 
0 < |x| < Ro, whose form depends upon νι and v2, as follows: 


Case 1. v1 — νῷ notan integer. Then 


va) 
γι) = [χ Ὁ Σ᾽) ax”, ao = 1, 
k=0 


I 
— 
Φ 


yo(x) = |x|? Σ) bux", do 
k=0 
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Case 2. Vv; = να = v. Then 


yi(x) = |x|’ >»; ax”, a = 1, 
k=0 


yo(x) = |x|’ > b,x” + γι In |x]. 


k=1 


Case 3. v1 — V2 a positive integer. Then 


yi(x) = |x!" >) ax", ao = 1, 
k—0 


Yo(x) = |x|” δ) b,x” + ογι(Χ)]π |x|, bo = 1, ca (fixed) constant.* 
k—=0 


Finally, the values of the constants appearing in each of these solutions 
can be determined directly from the differential equation by the method of 
undetermined coefficients. 


In the remainder of this section we sketch the argument leading to the solution 
involving a logarithmic term when vy; = vy. The reasoning in the case where 
V1 — Vo is a positive integer is similar, but more complicated, and will not be 
given. The interested reader can find the details in the text by Coddington men- 
tioned above. 

We begin by repeating a portion of our earlier argument, and attempt to de- 
termine the a; in 


x Ὁ a,x" (15-30) 
k=0 


so that the resulting expression satisfies (15-29) for 0 < x < Ro. This time, 
however, we also regard v as a variable, and write 


y(x,v) =x 2 αρχῆ. (15-31) 
k=0 


Moreover, we assume from the outset that ag = 1. Then if L denotes the linear 
differential operator xD? + xg(x)D + r(x), we have 


a0 k—1 
Ly(x, v) = Iv)x’ + χ' δ) μά + vax + DOIG + ν)αι.» + re-let x", 


k=1 j=0 


(15-32) 


* In certain instances it may happen that c = 0. Moreover, the various constants ao 
and do appearing in these expressions can be assigned nonzero values different from 1 
without affecting the validity of the results. 
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where the q;,_; and r;_; are the coefficients in the power series expansions of 4 and 
r about the origin. [See (15-21) and (15-—22).] We now use the recurrence relation 


k—1 
Ik + vag + DOIG + v)qe—j + τε. ἤα; = 0 
j=0 
to determine ay, dg,... in terms of v in such a way that every term but the first 
on the right-hand side of (15-32) vanishes. Denoting the resulting expressions by 
a;,(v) and substituting in (15-31), we obtain a function 


yi(x,v) = v1 +> ance | (15-33) 
k=1 
with the property that 
| Lyi(x, ») = 10)’. (15-34) 


(Recall that, by assumption, ag = 1.) But since vy, is a double root of the indicial 
equation J(v) = 0, 1) = ὦ — v4)”, and (15-34) may be written 


Ly\(x,v) = (ν — νι) χ᾽. (15-35) 


Thus Ly,(x, v) = 0 when v = ν;, and we conclude that the function y,(x, v,) is 
a solution of the equation Ly = 0. This, of course, agrees with our earlier results. 

The idea for obtaining a second solution in this case originates with the observa- 
tion that when (15-35) is differentiated with respect to v its right-hand side still 
vanishes when vy = ν!. Indeed, 


Ο — 11)?x” = xX — ν}2 + & — »y) In x]. 
But since 
ΟΣ ΞΡ by oe 
al yilx, v)] = ἢ yilx, ν) 


(see Exercise 13), (15-35) implies that 


1)? νια »| = 0 


when v = v;. Thus if we differentiate (15-33) term-by-term with respect ἴον 
and then set vy = vj, the resulting expression will formally satisfy the equation 
Ly = 0 for 0 < x < Ry. Denoting this expression by yo(x, v1) we have 


= 


y2(x, νι) = ap yi, v) = x’! > av)" + yi(x, v1) In x, 


v=) k=1 


which is precisely the form of the second solution given in the statement of 
Theorem 15-1 under Case 2. 
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EXERCISES 


Find two linearly independent solutions on the positive x-axis for each of the equations 
in Exercises 1 through 10. 


1. χγ' + x(x — Dy’ + Ὶ 2. xy’ + (1 — αν —y = 0 
3, x2y" + 3xy’ + (x + Dy = 0 4. x*y” + 2x2y’ — 2y = 0 

5. xy’ — (x + 3)y’ + 2y = 0 6. xy” + (2x + 3)y’ + 4y = 0 
7 8 

9 


x)y = 0 


xy’ + (αϑ — Dy’ + x?2y = 0 . x2y" — 2x2y’ + 20χ — ly = 0 
xy’ + ( — xy’ + 3y = 0 10. x2y” + x?y’ + Gx — 2y = 0 


11. Use Theorem 15-1 to determine the form of two linearly independent solutions 
about x = 0 for the equation 


x2y"” + xy’ + (x? — p*)y = 0, 
p areal number. Do not compute the solutions. 


12. Prove that the solutions y; and y2 given in Cases 2 and 3 of Theorem 15-1 are 
linearly independent in C(0, Ro) and C(— Ro, 0). 


13. Verify that 
ὃ ὃ 
ὃν [Ly(x, v)] = L Ε y&, »| 
when y(x, v) is defined by (15-31), and 


L = x?D? + xq(x)D + r(x). 


15-6 BESSEL’S EQUATION 


In this section we shall use the technique introduced above to find a basis for the 
solution space of the equation 


x2y!" + xy + (x? 13: p*)y = 0 (15-36) 


about the point x = O under the assumption that p is real. We recall (see Sec- 
tion 6-2) that (15-36) is known as Bessel’s equation of order p, and, as we shall 
see, it arises in the study of boundary-value problems involving Laplace’s equation 
and the wave equation. 

Since the indicial equation associated with (15-36) 15 


ν2 — p? = 0, (15-37) 


and has roots +p, Theorem 15-1 guarantees that Bessel’s equation of order p 
possesses a solution of the form 


yi(x) = x? δὴ ax", p >= 0, 
k=0 
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valid for all x. To evaluate the a; we observe that 


wo ie] 
2 2 k 2 k 
(x* — p*)yi(x) = x” δ᾽ ακ. οχ' — x? δ᾽ p?azx', 
k=2 k=0 


xyi(x) = x? δὲ (k + ρ)αιχ", 


k=0 
x?yi(x) = xP δὴ (ἀ + pik + p — Iazx”. 
k=0 


Thus (15-36) implies that 

Στὰ + pk + » -- I+ K+ p) — plaex® + Σ᾽ ag _ox" = 0, 
k=0 k=2 

or 


(2p + Wax + >> [kp + Κλαρ + ay _2)x* = 0, 


k=2 
and we therefore have 
= sey a hg 
| a, = QO, j= kip +k) kK > 2: 
From this it immediately follows that 
a; = a3 = a5 = τ = O, 
Gis fas a5) eee 
: 2(2p + 2) 
ao 


44" 2-4Qp + 2)ῶρ + 4) 


and, in general, 
df ἀκ. ne et tO, τ ο΄ ee -  - 2 
ag, = (—1) 2-4-6--- (Qk)Qp + 2)2p + 4)--- (ΩΡ + 2k) 
ao 


(—1)! —__ ο---. 
22kKI(p + Ip + 2)--- + &) 


ll 


Hence 


: (Ὁ 2p ᾿ 
eel 0 Σ᾽, 2IK(p τ a Se) 


where dy τέ 0 is an arbitrary constant. 
For various reasons, it turns out to be convenient to set 


Ϊ 


0 = rp + 1)’ 
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where I’ denotes the well-known gamma function defined by 
T(p) = [ “etd Ρ»... (15-39) 
0 


It can be shown that this integral converges for all p > 0, diverges to +o. when 
p = 0, and has the values 


rd) = 1, 
Γ + 1) = pl), p> 9, 


(see Exercise 1). In particular, '(n + 1) = n! whenever n is a positive integer, 
and for this reason the gamma function is also known as the generalized factorial 
function. Moreover, if we rewrite the identity ΓᾺΡ + 1) = pI(p) as 


τῳ) = FE), (15-40) 


we can use the values of Γίρ + 1) from (15-39) to assign meaning to I'(p) for 
nonintegral, negative p. Indeed, as it stands the right-hand side of (15—40) can be 
read as the definition of '(p) for —1 < p < 0, since Γ( + 1) is already defined 
in that interval. This done, we use (15-40) and the values just obtained to extend 
the definition of I'(p) to the interval —2 < p < —1. Continuing in this fashion 
we obtain a real-valued function defined for all values of the independent variable 
p, save p = 0, —1, —2,.... The graph of the resulting function is shown in 
Fig. 15-1. 


FIGURE 15-1 


We now return to (15-38), and set ag = 1/[2°I'(p + 1)] to obtain the first of the 
two particular solutions needed to solve Bessel’s equation. This solution is known 
as the Bessel function of order p of the first kind, and is denoted by Jp. Specifically, 


Sa x2htP 
Tn) = Do 1} χεετραις + Ip + 2D) PF Rp $1) ® 
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FIGURE 15-2 


Ps 


an expression which can be rewritten in simpler form as* 


(1). 2k+p 
ae Σ {Tk + ΓΚ +k + Ξε: ) on 
In particular, when p = 0, we have 
00 =| k 2k 
σα) = >> ay (3) ; (15-42) 
k=0 ᾿ 
and, more generally, when p is a non-negative integer ἢ, 
}" 2k-+n 
I(x) = Σ τ ἐς " aint Bl (3 ) (15-43) 


The graphs of Jo, ",, and Jz are sketched in Fig. 15-2. 


* Note that 
Tp - 1 {ὦ - 1ὴω -Ὁ 2):--- Oth} Ξ Γῳ -- 2). -Ἡ 2): - τ -Ἡ Δ) 


- Γῴ -Ὁ Κ)ίῳ -Ὁ Ὁ} 
=T(p+k-+ 1). 
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To complete our discussion of Bessel’s equation, it remains to find a second 
solution, linearly independent of J,. Again we use Theorem 15-1, dividing the 
argument into cases depending upon the value of p. 


Case 1. p > 0, 2p not an integer.* Here the roots of the indicial equation asso- 
ciated with (15-36) do not differ by an integer, and a second solution can be 
obtained by repeating the above argument with —p in place of p. Obviously this 
will lead to a series whose coefficients have the same form as before, and since the 
gamma function is defined for nonintegral negative values of its argument, the 
solution in question can be written 


J_,(x) = > ee cl) ee Gy (15-44 
POD = Lae F DIK — p+ DY ) 


for x > 0. (For negative values of x we must replace x~? by |x|~?. From now 
on, however, we shall restrict our attention to the positive x-axis.) Finally, we 
observe that (15-44) is defined even when p is of the form n + 3, n an integer, 
and again yields a solution which is linearly independent of J,. (See Exercises 
6 and 11 below.) Hence we conclude that the general solution of Bessel’s equation 
of order p is 


W(X) = CyJy(X) + CoJ_p(x), 
whenever p is not an integer. 
Case 2. p = 0. Here Bessel’s equation becomes 
xy” + γ' + xy = 0, (15-45) 


and its indicial equation has zero as a repeated root. Hence, by Theorem 15-1, 
we can find a second solution of the form 


Ky(x) = Σ᾽ bx” + Jo(x) In x, (15-46) 
k=1 
with 0 as above. To evaluate the ὃς we note that 


xKo(x) = Σ᾽ big ἢ xJo(x) In x, 
k=3 


Ko(x) = 3 kbyx*—! + Jo(x) In x + Zot) : 


k=1 


xKo(x) = Σ᾽ κ(ὰ — 1)bex*? + xJY(x) In x + 2Sh(x) — "0. 


k=1 


* Note that the difference of the roots of (15-37) will be an integer if and only if p is 
an integer or half an integer. 
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Thus (15-45) yields 


by + 4box + Σ᾽) {Κ᾿ δὰ + bia" 


k=3 


+ [xJO(x) + Jo(x) + xJo(x)] In x + 2Jo(x) = 0; 
and since xJ((x) + Jo(x) + xJo(x) = 0, we have 


by + Abox + >> kb, + beak’! = - 2700}. 


k=3 


Finally, by (15-42), 
yo(x) = = Le 1)" sei χ 


whence 


< τι = 4k ἘΞ 
δὶ + 4box + Le [k7b, - by_o]x** = > (—1)*+? ΣΉΝ ε 


k=3 k=1 


To facilitate the evaluation of the b;, we now multiply this expression by x and 
split the series on the left into its even and odd parts to obtain 


ριχ + >; [ΟΚ + 1)*boxaa + bopper" t* + 4box? 


k=1 
=< — 4k 
τ a [(2k)*bex a box—2)x?” = x ΞΕ ys (—1)**? TERI 
k=2 k=2 ') 
Thus δ᾽ = b3 = bs, ΞΞ "55 = 0, while 
4b, = de OO Sb oS (SI se OS 
2= 1, and (2k)*box + boro = (—1) 22k(KI)2° > i. 
Hence 
Ι 
bs = 55° 
] 
b4 = a3 ga (l oh 3) = — se (1 a 2), 
b μι π΄". : 15-47 
2k = (—1) PEK ye εὐ aes gael a (15-47) 


(see Exercise 4), and it follows that 


k+1 2k 
Ko(x) = p3 — (1 εὐ α νυν Ὁ ἢ (3) + Jo(x) In x. 
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FIGURE 15-3 


In theoretical work with Bessel functions it is common practice to replace Ko 
by a certain linear combination of Jg and Ky. The resulting function is known as 
the Bessel function of order zero of the second kind, and is defined by the formula 


2k 
O(a ba 4 BS) + Zac ind εὐ] 
(15-48) 


where Y = 0.57721566..., and is known as Euler’s constant.* The graph of 
Yo is shown in Fig. 15-3. 


Yo(x) = -Ξ Σ τα 


Case 3. p =n, an integer. This time the roots of (15--37) differ by 2n > 0, 
and Theorem 15-1 asserts that the second solution of Bessel’s equation is of the 
form 


K,(x) = > byx"t”" + cJn(x) In x, 


k=0 


where c is a constant. Here too the b, and c can be evaluated by the method of 
undetermined coefficients, but the argument is now exceptionally long and involved. 
Fortunately, we shall not have to use these functions in any of our later work, 


* The constant Y is defined to be the sum of the series 


2 /y at 
1+ (4+ n=). 
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and thus can omit the argument in favor of the result. It 15 


=e = k - 1)! 2k—n H, n 
Kt) = δ ἐπα "1 0), - 5G) 


k=0 
Ι τὸ (=D "THe + Ante] (x) 


where H, = 1+ 3+ τ. - I/n. 


Finally, we remark that it is customary to replace K, by a linear combination of 
J, and K,, denoted Y,, and called the Bessel function of order n of the second kind. 
It is defined by the formula 


a : — 1)! 2k—n Η, n 
aes Σ τ (3) x(n!) (3) 


any ct tl (2) 2 Λα αξ +9) 
ἊΣ κι(α + k)! 2 + = "0 )]π 5 ἘΎ 


EXERCISES 


1. (a) Starting with the definition of I'(p), prove that 
Γῴ + 1) = pr(p). 
(b) Prove that [(1) = 1, and that lim,o+ (yp) = 
2. (a) Show that Γ() = x. [Hint: Note that 


oO so 2 2 
[(}} = 4 [ [ e * TY ay dy, 


and evaluate the integral by changing to polar coordinates. ] 
(b) Find the value of I'(7/2), an integer. 

3. Discuss the behavior of Jp,(x) as x — 0. 

4. Prove Formula (15-47). 

5. Prove that 


£ Jo) = —J)(x). 


6. (a) Prove that the functions J, and J_» are linearly independent in C(O, co) for all 
nonintegral values of p. 
(b) Show that the function Yo defined in the text is a linear combination of Jo 
and Ko. 


7. Prove that 
J_n(x) = (—-1)"n&) 
for all integers 7. 


10. 


ἘΠ. 
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. (a) Prove that the general solution of 


— 2=*y + py =0, x > 0, 


γ' 


1S 
y = X°Z (BX), 
where Z, denotes the general solution of Bessel’s equation of order a, and β is a 
(real) constant not zero. 
(b) Use the result in (a) to find the general solution of 
yr + =" + by = 0, aand ὦ constants, ὁ > 0, 
and then show that 


a 
Jij2(x) = AE sin x. 


. (a) Prove that the general solution of the equation u” - x7u = O is 


2 
χ 
u= Vx Z1/4 (=) , 


where Z1/4 is the general solution of Bessel’s equation of order 4. 


(b) Solve the Riccati equation y’ = x? + y*. [Hint: Make the change of variable 
y = —u’/u and use the result in (a).] 


(a) Prove that the function y = e**Z,(Gx) is the general solution of the differential 


equation 
2 
1 2 a p 
y+ (L-ra)rt (arte -2-F)y=0 


whenever Z, is the general solution of Bessel’s equation of order p, and a and B 
are (real) constants, 8 σέ 0. 


(b) Use the result in (a) to find the general solution of 
xy” + (2x + I)y’ + Sx + Dy = 0. 


(a) Prove that the Wronskian of J, and J_, satisfies the differential equation 
d 
dx [x Wp, J_»)I = 0. 


[Hint: Use the Lagrange identity (Section 12—5).] 


(0) Use the result in (a) to prove that W[J,, J_p] = c/x, where c is a constant, 
and then use the series expansions for J,, J_», and their derivatives to show that 


| 2 
Td = p)(p) 


whenever p is not an integer. (Note that this argument also provides a proof of the 
fact that J, and J_, are linearly independent when p is not an integer.) 
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15-7 PROPERTIES OF BESSEL FUNCTIONS 


Now that we have the series expansions for J, and Y,, we are in a position to 
derive a number of important formulas involving Bessel functions and their deriv- 
atives. The first two are immediate consequences of (15-41), and read as follows: 


[xp] = x°Ip 209, (15-49) 


fx P(X) = x p41) (15-50) 


for all p, positive, negative, or zero. 
Indeed, by (15-41) and the identity '(p + k + 1) = (p+ KT (—p + 1), we 

have 

LS ee oe) ee 

dx oem 22k+rPkIT(k + pt+ 1) 


k 
x? +2p 


£ A 


= > (—1)'2(p +k) x2k+2p—1 
a 22k+PkIT(k + p + 1) 


_ > (—1)" κεῖτ 
= ERT + p) 


= x? Sp —1(X). 


This proves (15-49) and, with obvious modifications, (15-50) as well. A similar 


pair of formulas holds for Y,, but we omit the proof. 
When the derivatives appearing in (15-49) and (15-50) are expanded, these 


formulas become 

A pl elo (15-51) 
and 

xJp — PJyp = —XIp41; (15-52) 


from which, by adding and subtracting, we immediately obtain 


Theorem 15-2. The Bessel functions of the first kind satisfy the recurrence 
relations 
XJp414 -- 2pIp + XJp-1 = 0, (15-53) 
and 
ρα + 2.0 — Jp-1 = 0. (15-54) 


EXAMPLE (Bessel functions of the first kind of half-integral order). When p = 3, 


(15-41) becomes 
"ΜΕ (ς-- (3) 
σι 90.) = ἜΣ i ae - ΠΕΣ 
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But since 
ré@+k = ra f-3 ΑΕ at 4 
3-5-+-Qk4+ 1 
-3,5 6 T Drew, 
we find that 
Vx = yy 2k 
Vx x? x* x® 
᾿ς V27@) Το OAR aes = 
1 x? x° x! 
gers lee ae oe a 
= a sin x 
V2xT3) 
Finally, referring to Exercise 2 of Section 15-6, we see that 
= νίπῇ2, 
whence 
Dx, 
J1;2(x) = 2: sin x. (15-55) 
A similar argument shows that 
ῬἜ Ἅ 
J_4;2(x) = 2 COS x, (15-56) 


and it now follows from (15-53) that every Bessel function of the first kind of 
half-integral order (i.e., of order n + 4, n an integer) can be expressed in finite 
form in terms of elementary functions. For instance, 


l 
F3j2(x) = —Ja1j2%) + > Jia) 


2 |sinx 
πχὶ] x 


— COs x| ᾽ 


͵75,2(Χ) 


I 


3 
—J1;2(x) + 5 23/2) 


2 13sinx 3 cos x : 
= ,/— — ——— — sinx]> 
πχὶ x? x 


and so forth. In passing, we remark that the Bessel functions of half-integral 
order are the only Bessel functions with this special property; all others being 
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transcendental functions which cannot be written in closed form in terms of 
elementary functions.* 

The several formulas derived above are of crucial importance in solving bound- 
ary-value problems involving Bessel’s equation. So too is the information con- 
cerning the general behavior of Bessel functions that was established in Section 6-2, 
and we therefore conclude this section by reviewing and sharpening some of those 
results. 

First, we recall that every nontrivial solution of Bessel’s equation of order p 
has infinitely many zeros on the positive x-axis, and that the distance between 
successive zeros approaches πὶ as x approaches o. Thus both J, and J_, (or 
Y,, as the case may be) are “oscillatory” functions, and by the Sonin-Polya 
theorem we can even assert that the magnitude of their oscillations decreases with 
increasing x. In short, the graphs of J, and J_, (or Y,) have a damped oscillatory 
character; a fact which was borne out in the case of J,41/2 by the results of the 
preceding example. Actually, this rough description of the behavior of Bessel 
functions can be made much more precise. For instance, it is not too difficult 
to show that every solution of Bessel’s equation of order p can be written in the 
form 


rp(Xx) ; 
4/3 
where A, and w, are constants whose values depend upon p, and γ is a function, 


again dependent on p, which is bounded as x —> 0. Thus, for large values of x, 
y differs very little from the damped sinusoidal function 


y(x) = = sin (x + wy) + 


Ap . 
Th sin (x + wp), 


and, in particular, it follows that y(x) — 0 as x > 0.7 
Finally, in preparation for our study of boundary-value problems, we prove 
two further lemmas on the zeros of Bessel functions. 


Lemma 15-1. The zeros of Jp and Jp4.1 are distinct, and alternate on the 
positive x-axis. 


Proof. By (15-52), 
xJh(x) = pJ,(x) — xJp4i1(x). 


Thus if J,(xo) and Jp41(xo) were to vanish for some x9 > 0, J;(X0) would also 


* By definition, the class of elementary functions consists of all rational functions 
(quotients of polynomials), trigonometric functions, exponential functions, and their 
inverses. 

+ For a proof of this fact see Chapter 8 of G. P. Tolstov, Fourier Series, Prentice-Hall, 
Englewood Cliffs, N. J., 1962. 


15-7 | PROPERTIES OF BESSEL FUNCTIONS 609 


vanish, and the uniqueness theorem for initial-value problems involving second- 
order linear differential equations would then imply that J, = 0. This 15 nonsense, 
and it therefore follows that the zeros of J, and J, are distinct. 

To complete the proof, let Δ) < ἃς be consecutive positive zeros of J,. Then 
by (15-52), 

αι) = —JpQ1) and ὑυᾳφι(λ2) = —Jp(r2). 

But, by assumption, J3(\1) and JZ(A2) have opposite signs, and the above equalities 
then imply that J, must vanish at least once between A; and Ao. A similar 
argument using (15-51) shows that J, must vanish between consecutive zeros of 
Jy+1, and we are done. J 


Lemma 15-2. The function 
F(x) = αὔριο) + βχη 


has infinitely many zeros on the positive x-axis for all values of p and all 
constants a and B. 


Proof. Ifa = B = Othe assertion is obvious; if 8 = Ο it has already been proved; 
if a = Ο it is an immediate consequence of our results concerning the behavior 
of the zeros of J,. Thus we need only consider the case where a ~ Oand β ¥ 0. 

Here we let\; < Ag < τ" be the positive zeros of J,. Then since J, is positive 
in the interval (0, \,), negative in the interval (\1, \2), positive in (Ag, 3), etc., 
we have 


ποὺ < 0, σχῶ) > 0, σύ) < 0,.... 


Hence F(x) alternates in sign at the points \,, \2,..., and therefore vanishes 
somewhere between each of them. ἢ 


EXERCISES 


1. Prove that d/dx[x—?J,(x)] = —x—?Jp+1(x) for all p. 
2. Express J3 and J4 in terms of Jo and 1. 

3. Express Js in terms of Jo and υύ. 

4. Prove that 


J_1;2(x) = ge COS X. 
WX 
5. Show that 
| Jo(x) sin x dx = xJo(x)sinx — xJi(x) cos x + c¢ 
and that 
f Jo(x) cos x dx = xJo(x) cos x + xJi(x) sin x + ς, 


c an arbitrary constant. 
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6. Prove that 


J2(x) 
x 


(Qn -- 2)Wn(x) . (2n)! | In(x) 


2”-1(n — 1)!xr—! 2"n! x” 


[κω dx = Ji(x) + + + I(x) SL ois 


dx. 


+ 


7. Prove that 


xJi(x) = 45> (-1)" 1 nJon(x). 


n=1 
[Hint: Use the formula Jn41 + Jn—1 = (2n/x)Jn.] 
8. (a) Prove that 


i Inzi(x) dx = i In—1(x) dx 

0 0 

for all positive integers ἡ. [Hint: Integrate the recurrence relation J,-1 — 
J n+1 = 2. 7:] 

(Ὁ) Use the result in (a) to show that 


[κω dx = 1 


for all integers n > 1. (Remark. This result is also valid when n = 0.) 


9. Use the recurrence relation Jn—1 + Jn41 = (2n/x)Jn together with the result in 
Exercise 8(b) to show that 
| Ji) yy - 
0 x n 


for all integers n > 0. 
10. (a) Prove that 


2» 4 
»,.«Ο) - Uri πὶ το ποῦ. 


(Ὁ) Use the result in (a) to show that 


er ὩΣ τ er. 


= x dx 
11. Show that 
Jo(x) = Jo(x) + 2J0(x). 
12. Prove that 


kk -— 1 
2° 7 (x) = Φ,- κ(Χ) — kJIn—n42(*%) + τ or 


Jn—n+4(X) Tees 
+ (=1)'In 2), 


where 
κ 


I(x) = SFM), 
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13. Prove that 


n—1 
[πω dx = 2 ye Jn 42h4+1(X%) + “πω dx foralln > 0. 
k=0 
14. (a) Prove that 


xT = (t+ p+ ax! Spa) 
— χα νς 16) + Jq(x)Jn4i1(x)], 


d ae 
τς I Oa OI = (tt — p— gq — 2,)7χ Ip ior) 
Ἔχ αι ιν) + Ja )Jp41 00). 
(b) Add the two identities in (a) and then integrate to deduce that 
] (t+ p + φχ' ρα ςΟὐ dx + [ (-- » --αᾳ -- 2)x' "Jpg a41(x) dx 


= xoxox) + ρει αν, 10} +c, 
c an arbitrary constant. 


(c) Use the result in (b) to prove that 
2(p+1) 


2p+1 2 _ «x 2 2 
| x" [J,(x)V dx = 2p +1) {υ, ΑἹ) + VoqiQ)l} +. 


15. (a) Use the formula in Exercise 14(b) to prove that 
J(x)Jg(x) 
(0 + a) | LD ae ΠῚ 


+ {ὦ -Ἡ 1 - @+ Ἢ] Fetter OD ge — ιν 10}. 


(Ὁ) Iterate the result in (a) to obtain the formula 


(p+ 4) | BED ge = ὁ ΣῊ οὐλὴ δ — IONE 
k=0 


= IpinlSein0) + (o' @ + 2m) | Temas) pe 


(c) Use the preceding formula to deduce that 
In(x)} 1 ; n 
| Ol ae = — 3 {ocr τανῦν ἘΣ ort , 


16. Discuss the behavior of the positive zeros of the function ζ΄. 
17. Show that if y = x—?J,, then xy” + (2p + Ly’ + \2xy = 0. 
*18. (a) Prove that the Laplace transform of the function x?J,(Ax) is given by the formula 


Δ ΤΩρ + 1) 


L[x"J(Ax)] = Pp + 1)(s2 + 2) e742 
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for all non-negative values of x and ἃ and all non-negative integral p. [Hint: Show 
that y = x?J,(Ax) is a solution of the equation 


xy” + (1 — 2p)y’ + A\*xy = 0, 
and then deduce that 
aLly] s ds 
] 2 ΞΞ e 
cpl. ΣΎΝ 


Solve this equation for £[y], and complete the proof by evaluating the constant of 
integration. ] 

(b) Use the result in (a) to show that 

a ee οἷ 

(s2 + d2)1/2[s + (52 + A2)1/2]}" 


19. (a) Use the convolution theorem and Exercise 18(a) to show that 


L[n(Ax)] = 


[ *Jo(d)Jo(t -- λ) dd = sin x. 
0 


(b) Solve the initial-value problem 
y’ +y =Joix); yO) = yO) = 0, 


by Laplace transform methods, and then use the result to deduce that 


[ "sin (t — AJo(A) dd = xJi(x). 


*15-8 THE GENERATING FUNCTION 


In Section 15—6 we defined the function J,, n a non-negative integer, to be the 
solution of Bessel’s equation of order n whose series expansion about the origin 
converges for all x and has 1/(2"n!) as its leading coefficient. Although this is 
certainly the most natural way of approaching the study of Bessel functions of 
integral order, it is also possible to define these functions by means of a generating 
function G(x, t), in which case J,(x) appears as the nth coefficient in the series 
expansion of G developed in powers of 1. (See Section 11-8.) To accomplish 
this we set 

Gon Ty ἀπο 0, (15-57) 


and use the well-known power series expansion for the exponential function to 
write 


ὩΣ ἂν oF μα ἘΠ 
2 
eer πὸ at nee) a oe 
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Hence 


οο x” ᾿ (oa) 5 x” a 
cE Ne [2 ΝΗ ΠΣ {Ξε} Arta Ὁ 
n=0 n=0 


and since each of these series is absolutely convergent for all x and all t # 0 we 
can perform the indicated multiplication and rearrange terms to obtain 


Gx) = Σὲ Im", 


7. ΞΞξΞ------ὐ 


where the J,,(x) are functions of x alone. Moreover, an easy computation reveals 
that 


I(x) : , - ae 
-},υππὶ τὐ πες τ ἘΣ πότε t 
for n 0, and that 
J_n(x) = (—1)"n@) 
for n < 0, thereby proving 


Theorem 15-3. The function e!”''—[/0! generates the Bessel functions of 
integral order of the first kind in the sense that 


ο(τ 2118}. > Jn(x)t” (15-58) 


nr=-—0 


for all x and allt ¥ 0. 


(Incidentally, this result motivates the choice of the coefficient ay in the series 
expansion for J,, that was made in Section 15-6.) 

Having proved this theorem it is impossible to resist the temptation to do 
something with it, since we are now but a step away from a number of important 
results. To obtain them we make the change of variable 1 = e*? in (15-57), and 
use the identity οἶδ = cos θ + isin @ to write 


e@/2E—GIDT _ ett sin _ cos (x sin 6) + isin (x sin 8). 


Thus (15-58) becomes 
cos (x sin 6) + isin (x sin θ) = » J,(x)[cos né + isin μθ], 


and by equating real and imaginary parts and using the identity 


Jin(x) = (—1)"Jn), 
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we find that 
cos (x sin 8) = Jo(x) + 2 >», Jon(x) cos 2n8, 


n=l 


5 (15--59) 
sin (x sin 0) = 2 δ Jon41(x) sin (2n + 1)6.* 
n=O ; 
Continuing, we now multiply the first of these formulas by cos 2k6, the second 
by sin 2k6, and integrate the resulting expressions term-by-term over the interval 
0 < 6 < =z (an operation which is legitimate here) to obtain 


Jon(x) = 1 Ι cos (x sin θ) cos 2Κθ dé, 


: (15-60) 
0 = ὃ | sin (x sin @) sin 2ké dé. 
πο 
(See Exercise 1.) In exactly the same way we find that 
0 = L i cos (x sin 0) cos (2k + 1)0 d@, 
ae (15-61) 
7... 1(Χ) = 1} sin (x sin 6) sin (2k + 1)@ dé. 
0 
Finally, by adding these results and using the identity 
cos (n@ — xsin 6) = cos nécos (x sin θ) + sin ηθ sin (x sin 6), 
we deduce 
Theorem 15-4. Jf is a non-negative integer 
JIn(x) = : | cos (n@ — xsin 6) dé. (15-62) 
0 


This formula is sometimes called Bessel’s integral form for Jn. 

Actually, the argument we have just given proves more than this. For if x 15 
held fixed, and ax, b, and ἄμ, b, denote, respectively, the Fourier coefficients of 
the functions cos (x cos θ) and sin (x sin 0) on the interval Ὁ < 6 < z=, then 
(15-60) implies that 


Joi(x) = “3 4 
and (15-61) that 
b 
Jox41(X) = oe 


* The validity of these computations depends upon the fact that (15-58) is absolutely 
convergent for all t σέ 0, real or complex. 
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But by Corollary 8-1, we know that 


lim ao, = 0, lim box41 = 0; 
ko 


k— 00 


whence the following theorem. 


Theorem 15-5. For each fixed x > 0, J,(x) approaches zero asn -- o. 


EXERCISES 


1. Deduce (15-60) from (15-59) under the assumption that termwise integration is 
legitimate. 


2. Prove that |J,,(x)| < 1 for all integers , and all x. 
3. Verify that the coefficient J,(x) appearing in the series 


οο 
et! DU-A/9} ae by Tn(x)t” 


τσ 


is as asserted in the text. 
4. (a) Use the identity 


et/ DLE-C/ 9) /2)(t—-1/9)] = el Gr Π21{{--| 19] 


to prove that 


I(x + yy) = Σὺ σαν ,..0). 


k==—a 


(Ὁ) Set 7 = 0 in the above formula and show that 


Jo(x + y) = Jo(x)Jolv) + 2 D5 (- 1S). 


k=1 
(c) Prove that 


Vox + ὩΣ) MiG? = 1. 


k=] 
(d) Prove that 


In(2x) = δ Ine) + DD τα), 4400. 
k=0 k=1 
*5. (a) Show that 


T(x) =2 [ wo dre > ἢ 
0 


and then use this formula to prove that 


π|2 
I(p)T(q) | . 2p—l1 24ᾳ---Ἰ 
---΄΄“’ = 2 sin 6 cos 6 dé 
T'(p + 4) 0 


for allp > 0,g > 0. 
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(b) Use the result established in (a) to rewrite the series expansion for J, as 


= ΟἿ)» (-1)' με sin ἢ 
J p(x) T@rp + 3 ane ee Gk * sin”™” @cos” 6 dé, 


and then apply the Weierstrass M-test with 


5: om 


as the comparison series to show that 


I(x) = Tore rp, i pe aa (x cos 6)” dé. 


(c) Now prove that 
(x/2)” 
Γ( ΓΦ + 3) 


(This result is known as the Poisson Integral Form for Jp.) 


J(x) = | sin”? @ cos «x cos 6) dé. 
0 


The following exercises introduce the so-called modified Bessel functions of integral 
order, I,,(x). 


6. (a) Expand the function e@/2)+(/5! in powers of ¢ as 


oo 
1 
Benes /)) _ Σ I,(x)t", 


Ἦν ΞΞΞ--τοῦ 


and show that 


x x ἐς 
Wo = £4]1 + ay + ae nae t | 


3 1 (ἢ 
~ Lake τ WIND 


for all n > 0, and that 


I_,(x) = I,(). 
(b) Prove that 


Tan(—x) = Ton(X), Ton41(—x) = —Ton41(x), 


and 
for all integers ἡ. 
7. (a) Prove that 


4 [x"In(x)] = x"I,-1@) 
x 


eae) HCO: 
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(Ὁ) Prove that the functions 1, satisfy the following recurrence relations: 
Tn-1 — Tn4+1 - ἊΣ I, 


Ϊ,.--.- + In+1 = 21; 
| | — Th + Δ a 
x 


Inga = In — — Ih. 


8. Show that the modified Bessel function /,,(x) is a particular solution of the equation 


x2y" + xy! — (x? + ny = 0. 


15-9 STURM-LIOUVILLE PROBLEMS FOR BESSEL’S EQUATION 


In physical applications Bessel’s equation usually arises in the “‘parametric” form 


x*y" + xy’ + (\?x? — py = 0, (15-63) 


ἀ{ςὉ" 2 -2) = εν 
J (xB) + ρὸ ᾿ γΞ 9, (15-64) 


with ἃ a constant.* As such its solution space is spanned by the functions J,(Ax), 
and J_,(Ax) or Y,(Ax), depending upon the value of p. In this section we propose 
to establish the existence and orthogonality of eigenfunctions for a number of 
boundary-value problems involving Eq. (15-64) on the closed unit interval [0, 1] 
under the assumption that ἃ is a non-negative real number. Basically we shall 
use the method developed in Chapter 12, but must modify our arguments in 
certain particulars to accommodate the singularities in the equation and its solu- 
tions at the origin. For simplicity we continue to restrict our attention to Bessel 
functions of the first kind. 

In the first place, the fact that the parameter appearing in (15-64) is multiplied 
by x implies that we must use the weighted inner product 


or 


fig = [κοεχ dx (15-65) 


in @C[0, 1] throughout the following discussion. Moreover, in order to ensure 
that the functions J,(Ax), \ > 0, belong to this space we must demand that p 
be non-negative. For otherwise, J,(Ax) is unbounded as x — 0, and is not piece- 
wise continuous. Finally, since we shall be working on the interval [0, 1], and 


* The reader can verify that (15-63) is a variant of Bessel’s equation by making the 
change of variable s = dx in σόν" + sy’ + (62 — ρῶν = 0. Equation (15-64) is, of 
course, the self-adjoint form of (15-63). 
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since the leading coefficient of (15-64) vanishes when x = 0, we need only impose 
a boundary condition at the point x = 1. 
This said, we now consider the Sturm-Liouville problem consisting of 


d(,@ 2 ΡῚ = 
ae ( ΦῚ + (, x om Ei 0, (15-66) 
p > 0, > 0, and the single unmixed boundary condition 

Biy(1) + Bey’) = 9, (15-67) 


[β.| + |@2| τέ 0. By the results in Section 12-8 we can assert in advance that 
eigenfunctions belonging to distinct eigenvalues for this problem are mutually 
orthogonal in @@[0, 1]. Furthermore, the eigenfunctions belonging to a positive 
eigenvalue \, will be the nonzero multiples of Jp(\ox), while the eigenfunctions 
belonging to the eigenvalue 0 (if 0 is an eigenvalue) will be the nonzero multiples of 
x?, since in this case (15-66) reduces to the Euler equation 


ΧΡ" + xy’ ie p’y = 0. 


Thus, under the hypotheses imposed upon p and ) we need only examine the 
functions x? and J,(Ax), \ > 0, as potential eigenfunctions. And here we argue 
as follows. 


Case 1. By = 0. In this case (15-67) becomes 
yl) = 0, (15-68) 


and it follows that J,(\x) will be an eigenfunction if and only if J,(4) = 0. Hence 
the positive zeros \1 < Ay < "“" Of J, are eigenvalues and 


Tox), Kk = 1,255 


are eigenfunctions. Finally, since x? does not vanish when x = 1, \ = 0 15 not 
an eigenvalue, and the above list of eigenfunctions is complete. 


Case 2. B, = 0. Here (15-67) becomes 
γ΄) = 0, (15-69) 


and the positive zeros μῃ < μὲ «τ᾿ of J; are now eigenvalues (see Lemma 
15-2). In addition, the function x” satisfies (15-69) when p = 0, and in that case 
λ = 0 is also an eigenvalue. Thus the eigenfunctions for this problem are 


"ρίμμχ), k = 1,2,..., whenp > 0, 


and 
1, Jo(urx), kK = 1,2,..., whenp = 0. 
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Case 3. For various reasons the case 8; ~ 0, 82 # 0 is not particularly interest- 
ing, and 1s usually replaced by the more general requirement that when x = 1, 
Jp(Ax) satisfy the equation 


AJR(A) — AJ,(A) = 0, Aa constant. (15-70) 


(As we shall see, this type of boundary condition arises in the study of heat flow 
in cylindrical regions, and is not as artificial as one might think.) Since (15-70) 
has a variable coefficient i, it does not fall under any of the several types of bound- 
ary conditions discussed earlier, and therefore must be treated separately. 

We begin by applying Lemma 15-2 to assert that (15-70) has infinitely many 
positive zeros, vy < vo < +++, meaning, of course, that (15-70) is satisfied 
whenever \ = να. Hence the functions 


J (VEX), k= | Rae φῦ 


satisfy (15-66) and (15-70), and as a consequence are “‘eigenfunctions”’ for this 
problem. Moreover, reasoning as in Section 12-8, we find that these functions 
are mutually orthogonal in @@[0, 1] with respect to the weight function x. (See 
Exercise 2 below.) Thus, on the face of things, the situation here would appear 
to be identical with that discussed in each of the preceding cases. This, however, 
is not quite true, for it turns out that whenever p < ἢ, Eq. (15-70) has other roots 
in addition to the v,. Indeed, when p = h, Eq. (15-70) becomes 


λυ) — pJp(d) = 0, 
which, by (15-52), can be rewritten 
M41) = 0, 


and has \ = 0 asaroot. When p < ἢ the situation is much more complicated, 
and cannot possibly be treated with the tools we have available. Suffice it to say 
that the equation then admits a pair of imaginary roots +-ivy —a phenomenon 
which does not occur with any of the boundary conditions we have considered 
heretofore. In the next section we will find that the existence of these additional 
roots introduces difficulties in the study of series expansions relative to the orthog- 
onal set {J,(v;,x)}. 

In view of the now obvious fact that we will soon be computing series expan- 
sions relative to the eigenfunctions found above, we conclude this section by 
evaluating their norms in @C[0, 1]. The basic formula for all of these computa- 
tions is given in the following lemma. 


Lemma 15-3. For all non-negative real numbers p and }, 


; x2 — p? 
i p(ax)}'x dx = 3,0)? + a5 ~ MeO’. (15-71) 
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More generally,* 


b 
2 De αι δ᾽ -- ρ" 2 
: [Jp(0x)]}°x dx = 5 Va(rs)) + axa YS) (15-72) 
Proof. We begin by multiplying Bessel’s equation by 2y’ to obtain 


2x?y'y” + 2x(y')? + 263 — ρῦνν = 0, 
or 


[x?(y’)?]! + 2(x? — p*)y’y = 0. 
Rewriting this equation as 
[x?(y")?) + E(x? — p?)y?¥ — 2xy? = 0, 
we conclude that 
d 
2x (x) = A {x*Lb(x))? + (x? — ρ», ΑἹ"). 
Hence 
: λ λ 
2 υρουχ ἐς = PULP] + οὐ - PLOT 
0 0 0 


= MUA)? + QO? -- ρ», ΟΥ̓; 


the last step following from the fact that pJ,(0) = 0 for all p > 0. The desired 
result now follows. by setting x = λέ in the above integral. § 


When rewritten in terms of the inner product on @@(0, 1], Eq. (15-71) becomes 


Ox? = Or +P wor, (15-73) 
and yields the following important formulas. 
Case 1. dx the kth positive zero of Jp: 
rex] = SOx]? (15-74) 


The reader should note that by using Formula (15-52) this result can also be 
written 
pO? = Bred’. (15-75) 


Case 2. με the kth positive zero of J;: 


7 ς ον 
Vp (uxx)||? = a (uP. (15-76) 
Mk 


* This formula is applied when working on the interval [0, 5]. 
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In particular, when p = 0, we have 


| Jo(uxx)||? = 3o(ux))?, (15-77) 
and 
1 
Wi? = [ xdx = i. (15-78) 
0 
Case 3. vz, the Kth positive zero of dJ,(.\) — hJ,(): 
2 2 2 
Ido? = A? yar? (15-79) 
Vi, 


EXERCISES 


1. Verify that Eq. (15-63) is Bessel’s equation of order p in the variable \x. 


2. Apply the argument given in Section 12-8 to prove that the functions J,(%x), 
k = 1,2,..., discussed in Case 3 above are mutually orthogonal in @C[0, 1] with 
respect to the weight function x. 


3. Prove that x? is orthogonal in @C[0, 1] to each of the functions J,(¥,.x) when ἢ = p 
in (15-70). What does this imply about the set of functions J,(y,.x),k = 1,2,...? 


15-10 BESSEL SERIES OF THE FIRST AND SECOND KINDS 


Now that we have established the existence of an infinite set of mutually orthog- 
onal eigenfunctions for each of the boundary-value problems introduced above 
we are faced with the task of determining whether these sets of functions are bases 
for @C[0, 1]. With but one exception the answer is yes, and in general the results 
in this connection are analogous to those we have encountered in similar situations 
in the past. This time, however, we can do no more than state the relevant the- 
orems, since their proofs are far too difficult to be given here. The first and most 
important of them reads as follows. 


Theorem 15-6. Let d; < \2 < ::" be the positive zeros of J,(x), and 
suppose that p > Ὁ. Then the functions Jp(\,x), k = 1,2,..., are a basis 
for @C[0, 1], and every function in this space can be written uniquely in 
the form 


ce 


F(x) = ΣΣ codp(ix), (15-80) 


k=1 


where the series in question converges in the mean to f, and 


1 
2 
C= ioe |. T(x p(nx)x dx. (15-81) 
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Moreover, if f is piecewise smooth this series converges pointwise to 


1) + fo) 


for each Xo in the interval (0, 1), and the convergence is uniform on every 
closed subinterval of (0, 1) which does not contain a point of discontinuity of f. 


Remark. The series expansion given by (15-80) and (15-81) is also valid when 
-- < p < Oeven though the J,(\;x) do not belong to @C[0, 1] for these values 
of p. 

The series described in this theorem is known as the Bessel or Fourier-Bessel 
series for f of the first kind with respect to the functions J,(A,x). The reader should 
note that this result actually provides us with infinitely many different series of 
this kind, one for each admissible value of p. 


EXAMPLE 1. Find the Bessel series expansion with respect to J,(A,x) for the 
function x”, p = 0. 
In this case the coefficients in the series are given by the formula 


1 
2 | p+ 

ae eee Tp(ux) aX, 

rf ν» 10 λ}}}2 Jo Ἶ πῶ 


and can be evaluated by setting f = λρχ and using Formula (15-49), as follows: 


1 Ak 
Ι xP ΤΟ ΧῚ) dx = Ι 1?*17,(t) dt 


We 
i. ἡ“ ἃ 
7 tf qe oil εἰ 
k 


1 λ 
mea Caer Ole 


λει" 
] 
= χ, “ρειίλι). 
Thus 
2 
= -------------- ? St πρῶ τς as 
τ λ κυ. αλλ) 
and 
Tp) Jp(X2X) Jp(A3X) | 
pi. 9)/_“PVee 4 Pe eH > 15-82 
= ΕΞ Aad p41(r2) A3Jp 410s) ( ) 


where the series converges in the mean in ΦΟΙΌ, 1], pointwise in (0, 1), and uni- 
formly on any closed subinterval of (0, 1). 
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In particular, when p = 0, (15-82) yields the formula 


yee es Oe Sd. (15-83) 


EXAMPLE 2. Expand x”*,0 < x < 1, asa series in Jo(;x). 


Here 
1 


2 
j= Owe Ι χϑ)ο(λκχὶ) ax, 


and, reasoning as in the preceding example, we find that 


1 χὰ 
| x°Jo(A,x) dx = | t?Jo(t) dt 
0 λέ Jo 


᾿ς ἢ 
1” — [1J,(1)] dt 


χά 0 αἱ 

λ ve 
ten "2 | “σι a 
Ni 0 0 


Ak 
Tin) Ὁ | : 
= OF - -- tJ, (t) dt. 


I 


] 


But 


LY? Ak a 
| t?J,(t) dt - | t? = Jo(t) dt 
0 0 dt 


2 Ni ὼ 
-- (ἢ . + 2 : tJ o(t) dt 


Az 
2 £ th(O) dt 


2λμ (μι), 


and it follows that — 


1 
, Todax) de = L1H) _ 4,02), 
0 Nk ΝῊ 


Thus 
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and 


2 = Ι | 4 
xo = 2 — — —)Jo(rA 
Faw (is Ἢ) οἴλμχ), O< x <1 
Turning now to the functions J,(u,x), we have 


Theorem 15-7. Let uy < μὲ < °°: be the positive zeros of J,(x), p = 0. 
Then 
Jn(uex), K = 1,2,..., p> 0, 
and 
1, Jo(urx), k= 1,2,..., 


are bases for @C[0, 1], and series expansions relative to these bases converge 
in exactly the same way as the series described in the preceding theorem. 


In particular, it now follows from Formulas (15-76) and (15-77) that a function 
fin @eC[0, 1] can be written in the form 


co 


f(x) = D> crJp(urx), p > 0, (15-84) 
with " 
ἜΤ ΟΣ | “foavpuax) dx (15-85) 
[μὲ — pW p(un)V “9 
and 
f(x) = 2.9 + >> Cio] οίμκχ), (15-86) 
with = 


1 1 
Co = Ι {(ὺχ dx, i= Wa Ι S(xWo(urx)x dx, k>0. (15-87) 


A series of this type is usually said to be a Bessel series expansion of f of the second 
kind, or a Dini series expansion of f. 

Finally, a similar result holds for the functions J,(v;x) discussed in Case 3 
of the preceding section provided we insist that p be greater than h. On the other 
hand, when p < h, an additional function must be added to the J,(v;x) to obtain 
a basis for @C[0, 1]. When p = A, the function in question is x?, or any nonzero 
multiple of it (see Exercise 3, Section 15-9); but when p < A, it is considerably 
more complicated.* However, once this function is included with the J,(v,x), the 
analog of Theorems 15-6 and 15-7 goes through unchanged. 


ἘΠῚ is, in fact, I[p(vgx), where vg is chosen so that ivg is a root of the equation 
JZ(A) — AJC) = 0, and J, is the so-called ‘““modified”? Bessel function of order p of 
the first kind. (See Exercises 6 through 8 of Section 15-8.) 


15-10 BESSEL SERIES OF THE FIRST AND SECOND KINDS 


EXERCISES 


1. Prove that form > 1 


JiQ) 
eae 


2. Use the formula given in Exercise 1 to show that 


1 
y= 2 5Ε.- - ἜΘ Jo(rxt) a| Jo(A:x), 


1 
| x"Jo(Ax) dx = 
0 


hand Agi Ax)] 
forO < x <1. 
3. (a) Show that 
1 
[ xJo(kx)Jo(Azx) ax - ἐϑύλοσο πλωτοὶ o{k) 
ae Ἢ 

whenever ); 15 a zero of Jo. 

(b) Use the result.in (a) to deduce that 

Jo(kx) = 2Jo(k) per ------- Joe x), 


—] (7 —k ΤΥ ΝΕ 
for0 < x <1. 
4. Prove that 
fas? a8 “Ὁ 
k=1 Andi (Ax) 
ἴογ < x <1. 


1? (᾿ 
ἢ (A) — eo ) Ι x" 7 Jo(Ax) ax. 
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5. Expand the function x?, p > 0, in @C[0, 1] as a series involving the functions J(u; x). 


6. Prove that 
~~ Jo(ARx) 
fat λιν} 


for0 < x < 1. [Hint: Use integration by parts to evaluate 


Inx = —2 


1 
[ x In xJo(Azx) dx] 
7. (a) Prove that 


(zx) 
= A(p + 1) >> ἤει 
MS Ree χω 


for all p > 0, and all x in (0, 1). 
(b) Use the result in (a) to show that 


=< Jn +2(Acx) os 
kext Ard 41k) 


forO < x < 1. [Hint: Multiply the formula in (a) by x-@+ and differentiate. ] 
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15-11 LAPLACE’S EQUATION IN CYLINDRICAL COORDINATES 


At this point it should be abundantly clear that we have assembled more than 
enough information to solve boundary-value problems involving Bessel’s equation. 
Indeed, given what we now know, this is largely a matter of routine computation, 
and involves little that could not be left to the reader’s imagination—and the 
exercises. But, in the interest of completeness, we shall devote the following pages 
to a brief discussion of several problems of this type, producing a formal series 
solution for each of them. Of course, once this has been done we are still faced 
with the task of determining conditions under which these series actually satisfy 
the problems they purport to solve. Here, however, the technical difficulties are 
formidable, and force us to be content with the vague statement that all of our 
results are valid whenever the functions involved are sufficiently smooth. 

This said, we turn our attention to Laplace’s equation in cylindrical regions, 
which we first propose to solve under the assumption that the solutions are in- 
dependent of the polar angle @. In this case the relevant version of Laplace’s 
equation is 

07u lou. d7u 

Soe ae ee 0 (15-88) 
(see Section 15-1), and we remind the reader that its solutions can be interpreted 
as steady-state temperature distributions in the region in question. 


EXAMPLE 1. Solve Eq. (15-88) in the cylindrical region r<1,0<z<a 
(Fig. 15-4) under the assumption that 


u(1,z) = 0, 
u(r, a) = 0, (15-89) 
u(r, 0) = f(r). 


Applying the method of separation of variables with u(r, z) = R(7)Z(z) we 
obtain the equations 


rR’ ++ R4R=0, 
. (15-90) 
Z" -- °Z = 0, 


λ a (positive) constant, and the endpoint conditions 
R(1) = 0, 
Z(a) = 0. 


(15-91) 


The first of these equations is Bessel’s equation of order 
zero in the variable \r, and has 


R(r) = AJo(\r) + BYoQr), FIGURE 15-4 
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A and B constants, as its general solution. The requirement that R be continuous 
at the origin forces us to set B = 0, while (15-91) implies that Jo(4) = 0. Thus 
the admissible values of ἃ are the positive zeros of J/g, and we have shown that up 
to constant multiples R must be one of the functions 


R;(r) = Jo(x7), k= l, 7) cee 
Moreover, when ἃ = ), the general solution of 


Ζ’ —r»zZ=0, Za) = 0, 
iS 
Ζ,(2) = Ax sinh Aza — Z), 


where A; is an arbitrary constant (see p. 549). Thus the functions 
u,(r,Z) = A, sinh λχία — z)Jo(Agr), k = 1,2,..., 


are solutions of (15-88) and satisfy the boundary conditions u(1, z) = u(r, a) = 0. 
To accommodate the remaining boundary condition we now form the series 


u(r, Ζ) = >> A; sinh λχκία — z)Jo(rz7), (15-92) 


k=1 


set z = 0, and replace u(r, 0) by f(r) to obtain 
fr) = >> Ax sinh (λκαμολν). 
| k=1 


By our earlier results we know that this equation can be satisfied for any / in 
@e[0, 1] by letting A; sinh (λμα) be the kth coefficient in the series expansion of f 
relative to the functions Jo(\zr). Hence 


1 
2 
4, = Win? sinh (za) Ι f(r WoQr)r dr, 


and we are done. 


EXAMPLE 2. Find the steady-state temperature in the cylindrical region described 
above, given that 
u(r, a) = 0, 
u,(1,z) = hu(1, z), Aa constant, (15-93) 


u(r, 0) = f(r). 


Physically these conditions assert that the base of the cylinder is maintained at a 
known temperature f(r), the top at zero, and that the lateral surface exchanges 
heat freely with the surrounding medium at a rate proportional to the temperature 
of the surface. 
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This time we must solve the pair of equations in (15-90) in the presence of the 
endpoint conditions 
"(1) — ἘΞ 
Κ΄ (1) — ARQ) = 90, (15-94) 
Z(a) = 0. 
Reasoning as before, we find that up to constant multiples, 
R(r) = Jo(ar), 
and (15-94) now implies that \ must be a root of the equation 


Ar) — AT o(d) = 0. 


Again our earlier results allow us to assert the existence of infinitely many such 
roots vy < ve < --", all of which are positive, and with them, solutions 


Ri(r) = Jo(vir), &k = 1,2,.... 
Since the corresponding solutions of the equation involving Z are 
Z,(z) = Ax sinh νκ(α — 2), 


we find that 
u(r,z) = >, A, sinh νκία — zor), (15-95) 
k=1 
where the A; are chosen so that 
fr) = >> Ag sinh (x4 Vo(x7). 
k=1 


(Note that the existence of this series for any f in @C[0, 1] is guaranteed only if 
h < 0. Otherwise a more complicated series must be used.) Thus, by Formula 
(15-79), we have 


1 
eee es ees | : 
“Στ τὸ 


and the solution is complete. 


EXAMPLE 3. As our final example of this type we again solve Eq. (15-88) in the 
region r < 1,0 < z < a, but now impose the boundary conditions 
u(r,0) = 0, 
u(r,a) = 0, (15-97) 
u(1, z) = f(z). 
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This time the method of separation of variables leads to the pair of equations 


Z" + °Z = 0, 
: (15-98) 
” - Rr a 
R” + —R' — R= 0, 


and endpoint conditions Z(0) = Z(a) = 0. (Here the choice of sign on \? is 


dictated by the requirement that the solutions vanish at the endpoints of the 
cylinder.) It follows at once that the only possible solutions of the first equation are 


δὲ Ke ΞΞ Lg De tds 


Filey Aka tz 
corresponding to the eigenvalues \, = kz/a, and it remains to solve 
RY +" R — YR =0 (15-99) 


for each of these values of \. To this end we make the change of variable t = idr 
(i = ./—1), and rewrite (15-99) as 


a, ©, δ εν αν. ὃς 2 = 
OMe ap 
or 
d’R 148 
atria t k= Ὁ 


which we recognize as Bessel’s equation of order zero in the variable 1. Thus, 
up to constant multiples, the only solutions of (15-99) which are continuous at 
the origin are of the form 

R(r) = Jo(inr). 


Using the formula for the series expansion of Jj, we have 
> ς- 1} (inr)?* 
a 22k(k1)2 


Ν 00 (nry** 
7 2 22k(KI)2 


Jor) 


I 


and it follows that Jo(i\r) is a real-valued function after all. In view of this fact 
it is reasonable to adopt a notation which does not (misleadingly) involve i, and 


SO we set 


k 
x? 


_ Io(x) = dy 22k(KN)2 (15-100) 
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The function J) (which the student should regard as being defined by this series) 
is called the modified Bessel function of order zero of the first kind (see Exercise 6, 
Section 15-8), and in the present case allows us to write 


R(r) = Io(Ar). 


In particular, when ἃ = x = kx/a, 


Riulr) = Io (=), 


a 


and we conclude that the solution of the boundary-value problem under discussion 


is of the form 
< kar\ . {Κπ2Ζ 
u(r, Ζ) = 2 Axlo (πὴ sin (‘) . (15-101) 


Finally, to determine the values of A, we setr = 1, and u(1, z) = f(z) to obtain 


Κῶ = Σ Arlo (=) sin (#22) | 


Thus the A; are determined by the requirement that A;,Jo(k1/a) be the kth coeffi- 
cient in the Fourier sine series expansion of f on the interval [0, a], and we have 


2 “ . ΚπΖ 
A, = eos) (2 sin τ dz. (15-102) 


EXERCISES 


1. Find the steady-state temperature in the cylindrical region r < 1,0 < z < a, given 
that the solution μ is independent of 6, and 


u(r,0) = f(y), u(r, a) = 50), =u, z) = 0. 
2. Solve the problem in Exercise 1 under the boundary conditions 
u(r,0) = f(r), ulr,a) = 5, =u, z) = 100. 


3. Find the steady-state temperature distribution u = u(r, z) in the cylinder r < 1, 
0 < z < a, given that 


u(r, 0) = 100, u(r, a) = 0, u(1,z) = 0. 


4. Find the steady-state temperature distribution u = u(r, 2) in the cylindrical region 
r<1,0 « z < a, given that 


u(r,0) = (Ὁ, ulr,a) = 100, u- (1, 2) = 0. 
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(The last boundary condition asserts that the lateral surface of the cylinder is in- 
sulated so that no heat flows across it.) 

5. Discuss the nature of the solutions of Laplace’s equation in the cylindrical region 
r < 1,0 < z < a, which depend upon only one of the variables r, 0, z. Which of 
them can describe steady-state temperature distributions in the cylinder ? 


15-12 THE VIBRATING CIRCULAR MEMBRANE 


In this section we consider the problem of describing the motion of a vibrating 
circular membrane such as the head of a drum under the assumption that the 
membrane is held fixed on the boundary of the circle and given a definite displace- 
ment and velocity at time f = 0. In other words, we propose to solve the two- 
dimensional wave equation 


O7u Ι ou 1 07u 1 07u 
2 a ee a ee 


or? r or r2 802 a2 ot? (15-103) 


in a circular region, which for convenience we take to be r < 1, given that 


u(1, 6, ἢ = 0, 
u(r, 6,0) = f(r, 4), (15-104) 
u,(r, 0, 0) =F a(r, 0). 


We again begin by seeking solutions for (15-103) which are independent of θ, in 
which case the equation and boundary conditions become 


2 2 
cap. a> 0, (15-105) 
and 
u(1, ὃ = 0, 
u(r,0) = f(), (15-106) 


u(r, 0) = 50). 


Arguing in the usual fashion we set u(r, ἢ = Κρ ΤΑ, and find that (15-105) 
becomes 


RU + (/)R 11’ 
R - az T ; 


where } is a positive constant. (The choice of sign here is forced upon us by the 
requirement that T be periodic.) Thus R and T must be solutions of the equations 


ΚΕ’ + IR + R = 0, (15-107) 


T" + 7a°T = 0, (15-108) 
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and, in addition, R must satisfy the boundary condition R(1) = 0. Starting with 
the general solution 
R(r) = σον) + BY (rr) 


of (15-107), we first set B = 0 in order to ensure the continuity of R at the origin, 
and then apply the given boundary condition to deduce that, up to constant mul- 
tiples, R must be one of the functions 


Κι) = JoQrr), Κατ 1,2,..., 


where i, is the kth positive zero of Jp. Moreover, with these as the values of ἃ 
the solutions of (15-108) are 


T;,(t) = A; cos (Apat) + By, sin Q,zat), kK = 1,2,..., 
A,, B, constants, and it follows that the functions 
u(r, ἢ) = [Ax cos Axat) + B, sin Azat)VoQxr), 
k = 1,2,..., satisfy (15-105) and the boundary condition u(1, ἢ) = 0. 


To find a solution u(r, ἢ) which also satisfies the given initial conditions we set 


u(r, 1) = >) [Agcos (καῇ + By sin (Axat)Vo(Axr), (15-109) 
k=l 
and attempt to determine the A; and 8. so that 
u(r, 0) = f(r), 
u(r, 0) ἘΣ g(r). 


Thus when t = 0, (15-109) must reduce to 
Κὸ = DS ἁμοθν), 
k==1 


and we find that 


en ee 
— Ww)? 


A similar argument applied to the series obtained by differentiating (15-109) 
term-by-term with respect to ¢ yields 


1 
Ax, / μοί dr. (15-110) 
0 


2 


BS 
© MAN OWE 


1 
| g(r Jo(axr)r ar, (15-111) 
0 


and the problem 15 solved. 
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We now turn to the general case with solutions dependent upon @. Here we 
start by setting u(r, θ, ὃ = R(r)O(4)T(d) in (15-103) to obtain 


R" πε Θ΄. 15 ὸς οκ 


R 0 aT 
where, as before, \ is a positive constant. From this we obtain the pair of equations 
T"” + d*a°T = 0, 
Κ΄ 1.1’ 1 0” | 2 
RtpRtR Oe” 
the second of which we rewrite as 


_ RY + ΑΔΕ’ + NR _ 0” _ op 
(1/r2)R 6 ie 


where μ > 0 is again a constant. (The choice of sign is dictated by the fact that © 
must be periodic with period 27.) Thus we must solve the equations 


T’ + d7%a°T = 0, (15-112) 
r?R” + rR’ + (\?r? — w?)R = 0, (15-113) 
©” + μθ = 0, (15-114) 


subject to the boundary condition 
R(1) = 0. (15-115) 


Starting with (15-114), we use the periodicity of © to deduce that the only 
admissible values of u are 


μι =n, n= 0,1,2,. 
and hence that © must be a linear combination of the functions 


cosné, sinné. 


Furthermore, when μ = ἡ, (15-113) is Bessel’s equation of order n, and (15-115) 
implies that its solutions must be constant multiples of the function 


Κι ΚΟ) = Jn(ntr), &k = 1,2,. 


where the λρκ are the positive zeros of J,. (We again reject solutions involving Yn 
because of their discontinuity at the origin.) Finally, when ἃ = λ,,, (15-112) 
ylelds 

Trt) pa Ank COs (AXnkt) + Buk sin (AAnxt), 
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where A, and B,, are arbitrary constants. Putting these results together, we 
conclude that the functions 


Unk(r, 8, ἢ = [Anz COS (AAngt) + Bax Sin (AAnkt)] cos (nO)Jn(nkr) 
and 
Unk(l, 0, t) ΝΣ [Ank COS (αλ, ἢ = Buk sin (AAnxt)] sin (20) Jn nk’) 
n= 0,1,2,..., kK = 1,2,..., 
are solutions of (15-103) which satisfy the boundary condition u(1, 6, 7) = 0. 
To complete the solution we now set 


ive) ie.) 


u(r, θ, 1) = D> >> [unelr, 1) + vnelr, 4, 2], (15-116) 


nm=0 k=1 


and determine the coefficients Anz, Brr, Ants Bnz So that u(r, 0,0) = f(r, 6) and 
u(r, 6,0) = g(r, 6). Thus, when ὦ = 0, (15-116) must reduce to 


οΌ 


fir, 0) = δὴ ST [unalr, 6,0) + Parle, 8, 0D] 
k=1 


n=0 


OT 
οο 


I(r, =) = >> [Σ [AntIn(nkr)] cos πθ + > [AntIn(Ankr)] sin πθὶ. (15-117) 


0 \k=1 k=1 


To evaluate these coefficients, we expand /(r, 0) in a Fourier series with respect 
to the variable 6, obtaining 


fr, 9) = 2 fan(r) cos né + 5b,(r) sin η6], (15-118) 
n=0 


with ᾿ 
Ι 
ar) = a7 [ f(r, 6) dO, 


a,(r) = ἯΙ I(r, θ) cos πθ dé, 
ONE 1 fr, 6) sin μθ dé. 


—T 


Comparing (15-117) and (15-118), we see that 


a,(r) a » AnkIn(nkl)s and 6, (7) ἘΞ oe AnkIn(nk? Js 
k=1 
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for all m. Hence the A,,, and A,,; must be the coefficients in the Bessel series expan- 
sions of a,(r) and b,(r) with respect to the functions J,(Anzr), and we have 


1 
᾿ | 
- al Wn(rnkr yr ἀν, 
ΝΠ a 
> 1 
Ank = ----:----ςς bn(r Wann dr. 
ἽΝ κε] (MnOnar ἐν 


Thus 


1 τ 
1 
Aoz = ΠΕ Ἰ-. S(r, YIJo(doxr)r 40 dr, 


2 


Ank = =o 
ὩΣ 


1 ΐτ 
| | f(r, 9) cos (nO)JnQnkzr)r dé dr, 
0 --π 


1 x 
= 2 : 
Ank = mpOwl? Traian)? Ι is S(r, 9) sin (nO@)on(Qnzr)r dé dr. 


A similar computation starting with the series obtained by differentiating 
(15-116) term-by-term with respect to ¢ reveals that 


1 κ 
l 
Box = Too: ow? Ι ᾿ g(r, 8)Jo(Aoxr)r dé dr, 


1 τ 
2 
Baz = παλ, 7, τ ἘΣ i [ g(r, 6) COS (n0)Jnnkr rv dé dr, 


1 π 
= 2 : 
Bui = παλ, 7, 41 nw i [ g(r, 6) sin (20)Jn(Xnkr)r dé dr, 


and we are done. 


EXERCISES 


1. An object located at the point x = xg starts from rest and moves along the x-axis 
under the action of a force directed toward the origin whose magnitude is propor- 
tional to the distance of the object from the origin and to its mass, and initially is 
moxo. Determine the motion of the object if its mass m varies with time according 
to the formula m = mo(1 + ὃ. 


2. A uniform, flexible cable of length L is suspended vertically as shown in Fig. 15-5. 
At time t = 0 that portion of the cable between x = Oand x = aL is givena uniform 
horizontal velocity v = f(x). Describe the subsequent behavior of the cable, given 
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that its motion is governed by the equation Z 


a’y af oy 
Oe Bg oy 
ὁ12 Ox Ox 


where g is the acceleration due to gravity. [Note. The i 

x-axis is directed upward with the cable suspended from ae 

the point (ZL, 0).] v= fo) 
FIGURE 15-5 aa 


3. Find the steady-state temperature distribution u(r, θ, 2) in the cylindrical region 
r< 1,0 « 2 < a,giventhat 


u(1,6,z)= 0, u,9,a)=0, u(r, 0,0) = f(r, 4). 


4. Find the temperature u(r, 0, ἢ) in the two-dimensional region shown in Fig. 15-6, 
given that the boundary of the region is maintained at a temperature of 0°, and that 
at time ¢ = 0 the interior is at a uniform temperature of 100°. 


Ζ 


FIGURE 15-6 FIGURE 15-7 FIGURE 15-8 


5. Find the equation of motion of a vibrating membrane of the shape shown in Fig. 
15-7, under the assumption that the membrane is held fixed along its boundary and 
is released from rest at time ¢ = 0 from a known position. 


6. Solve Exercise 5 when the membrane is also given a known initial velocity. 
7. Generalize the results of Exercises 5 and 6 to the case of an arbitrary wedge-shaped 
region with central angle a. 


8. Find the steady-state temperature distribution in the semicylindrical region shown 
in Fig. 15-8, given that the temperature on the upper face is held at a known value 
f(r, 9), while that on all the remaining faces is zero. 


APPENDIX | 


infinite series 


I-1 INTRODUCTION 


The objective of this appendix is to provide a reasonably complete account of 
the material relating to the convergence of sequences and series that was used 
in the body of the text. From the standpoint of logical completeness this discus- 
sion Ought to begin with a detailed study of the real number system, including its 
construction out of the rationals. This, however, is a lengthy undertaking which 
properly belongs in a text on advanced calculus. Hence, rather than attempt it 
here we shall assume that the student has a working knowledge of the real number 
system, at least to the extent normally taught in a first course in calculus, and 
we shall base our discussion upon it. 

Actually it is possible to give a rigorous, self-contained account of the theory 
of sequential convergence if one is willing to accept, as given, a set ® of objects 
called real numbers which can be added, subtracted, multiplied, and divided 
according to the familiar rules of arithmetic. In addition, it is necessary to assume 
(a) that ® contains the ordinary integers as a subset, (b) that ® is ordered by a 
relation < having all the properties usually associated with this symbol, and 
(c) that ® satisfies the so-called least upper bound principle which we now proceed 
to state. 


Definition I-1._ A real number ὦ is said to be an upper bound for a (non- 
empty) set ὃ of real numbers if and only if s < 6 for all sin 8. If, in addi- 
tion, no number smaller than ὁ is an upper bound for 8, then 6 is said to 
be a least upper bound (l.u.b.) for 8. (The terms lower bound and greatest 
lower bound (g.1.b.) are defined similarly.) 


In these terms the least upper bound principle—which, by the way, is actually a 
theorem concerning the real numbers—reads as follows: 


Least upper bound principle. Every (nonempty) set of real numbers which is 
bounded from above has a least upper bound. (Again there is a companion state- 
ment concerning lower bounds which we omit.) 


And once this statement has been accepted we are back on solid ground where 
theorems can be proved and definitions given without further gaps in the reasoning. 
637 
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Needless to say, we shall not attempt to give a complete treatment of the several 
topics mentioned above, since this would entail writing an entire text, or more on 
advanced calculus. Neither shall we prove every assertion that is made as we 
progress, since this too would result in a labored discussion. We do, however, 
insist upon the fact that these proofs are now within our reach, and want only 
time and patience to present. 


Ι-2Ώ SEQUENTIAL CONVERGENCE 


We assume that the reader is already familiar with the notion of a sequence {a;,} 
of real numbers, which, we recall, is simply an ordered list 


(61. G5 «645: Oky 2} 


of real numbers indexed by the positive integers, or, more formally, a real valued 
function F whose domain is the positive integers, and whose value F(k) at k is ax. 
Actually, there is no reason to insist that the indexing always begin with the sub- 
script one, and when convenient we shall change it without comment. 

This said, we now introduce the concept of sequential convergence, as follows. 


Definition I-2. A sequence {a;,} of real numbers is said to converge to the 
number aif, given any € > 0, there exists an integer K (depending in general 
upon €) such that 


|az, — al «ε (I-1) 
for all k > K. When this happens we say that a is the /imit of {a,}, and 
write 

lim a, = 4, or {αν} — a. 
ka 


If, on the other hand, no such number exists, {a;} is said to diverge. 


Implicit in the statement of this definition is the assertion that the limit of a con- 
vergent sequence is unique. To see this, suppose that {a,} converges to a, and let 
a’ ~£ a. Thenif ε = |a — a’|/3 and if K is chosen so that |a, — αἱ < ε for all 
k > Καὶ the only entries in {αι} which do not lie in the interval (a — €,a + 6) 
are dj, do,..., ax, and it follows that {a,} does not converge to a’. 

Having defined the notion of convergence, we now address ourselves to the 
problem of determining whether a given sequence converges or not. For this 
purpose, Definition I-2 is manifestly unsatisfactory, since it requires us to find 
the limit of the sequence before we can establish its convergence. Thus it is natural 
to seek a convergence criterion which can be applied directly to the terms of the 
sequence themselves. One, which is easily deduced from the least upper bound 
property, reads as follows. 
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Theorem I-1. A monotonically nondecreasing sequence converges if and only 
if it is bounded from above, while a monotonically nonincreasing sequence 
converges if and only if it is bounded from below. 


(Recall that {ἀμ} is said to be monotonically nondecreasing if aj < dg < ag < °°"; 
monotonically nonincreasing if a, > ag > a3 11.) 


Proof. Let {az} be monotonically nondecreasing. Then if {αν} is bounded from 
above it has a least upper bound a, and hence, given any e > 0, there exists an 
integer K such that |a — ax| < ε. Sinceax < a, < aforallk > K, it follows 
that |a — a,| < efork > K, and {a,} — a. 

Conversely, if {a,} is not bounded from above, then for each real number a 
we can find an integer Καὶ such that a < ag. Setting ε = |a — ax|, we have 
la — a,| > efor allk > K. Thus {a;} does not converge to a, and since a was 
arbitrary, we conclude that {a;} diverges. 

This proves the first assertion in the theorem and, with obvious modifications, 
the second as well. ἢ 


Using this result, it is now relatively easy to establish a criterion which will 
enable us to test an arbitrary sequence for convergence merely by examining its 
terms. But first, a definition. 


Definition I-3. A sequence {a;} is said to be a Cauchy sequence if for each 
e > 0 there exists an integer K, depending upon e, such that 


|@m — ἀμ! < € (I-2) 
for allm,n > K. 


The convergence criterion we now propose to establish asserts that the class of 
Cauchy sequences is identical with the class of convergent sequences. This is easily 
the most important single result on sequential convergence. 


Theorem I~2. A sequence {a,} of real numbers is convergent if and only if 
it is a Cauchy sequence. 


Proof. Suppose that {a,} is convergent, with a as its limit. Then, given any ε > 0, 
we can find an integer K such that |a — a,| < €/2 for allk > K. Thus, if mand 
n are both greater than K, 


lam — Ωρ] = |\(Qm — a) + (a — α,}} 
< lan — αἱ + [α — a,| 
ε ε 
«515» = 6 


and {a,} is a Cauchy sequence. 
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Conversely, suppose that {a,} is a Cauchy sequence. Then, in particular, 
{ax} is bounded from above and from below. Indeed, if ε > 0 is given, and K 
is Chosen so that |a, — a,| < ε for all m,n > Καὶ, then none of the a can be 
greater than the largest number among a), do,...,@x,ax+41 + €,and nonecan be 
smaller than the smallest number among aj, d2,..., ax, a@x41 — €. This said, let 


δι = l.u.b. of the sequence {aj, ag, ...}, 
be 


l.u.b. of the sequence {do, a3, ...}, 


δὲ = l.u.b. of the sequence {a,, ax41,...}. 


Then δι > bo > bg > τ, and each Bb; 1s at least as large as the greatest lower 
bound of {a;,da2,...}. Hence {b,} is a monotonic nonincreasing sequence 
bounded from below, and therefore has a limit a (Theorem I-1). We now propose 
to show that a is also the limit of {a,'. To this end, let e > 0 be given, and let 
K, be chosen so that |a,, — a,| < €/3 for allm,n > Κι. (The existence of such 
an integer follows from the assumption that {a;} is a Cauchy sequence.) Let K» 
be chosen so that |a — δι < €/3 for all k > Ke, and let K be the larger of Κι 
and Ky. Then, ifk > K, 


Ια — ακὶ < la — δε] + ἰδὲ — αμὶ 
< ; + [δὰ — ag. 
But since b; is the least upper bound of {a,, a,41,...}, there exists an index 
p = Καὶ such that |b, — a,| < €/3. Hence 


ἰδ. — αμὶ “ [be — αρὶ + lap — an 
e ,€ 2ε 
Sg δ 
Combining these results we have 
e , 2€ 
la — a,| re ee ae ae é, 


and it follows that {ἀρ} converges to a, as asserted. ἢ 


EXAMPLE |. The sequence 


is obviously a Cauchy sequence, and hence converges. Here, of course, we could 
just as easily have applied Definition I-2, since it is clear that the sequence in ques- 
tion converges to zero. 
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EXAMPLE 2. The sequence {1, —1, 1, —1,...} is not a Cauchy sequence, and hence 
does not converge. 


The argument given in this section can be summarized by saying that the least 
upper bound principle implies that every Cauchy sequence of real numbers is 
convergent. It is also possible to turn things around, and deduce the least upper 
bound principle from Theorem I-2. In short, these two facts concerning the real 
number system are equivalent, and either can be taken as the starting point for 
the study of infinite series, and, in fact, the entire theory of real valued functions 
of a real variable. We omit the proof. 


We conclude this section by proving an elementary computational theorem 
which will be needed below. 


Theorem I-3. Let {αν} and {b;,} be convergent sequences with 
lim a, = α, lim b, = δ. 
Κ-- kw 

Then 

(i) {az + 8b,} is convergent for all real numbers a and B, and 


lim (aa, + Bb.) = aa + Bb; 


(ii) {a;,b;,} is convergent, and 
lim a,b, = ab. 
k— 00 
Proof. We leave to the reader the easy task of verifying that {aa,} —> aa when- 


ever {a,} — a. This proved, (i) will follow as soon as we show that {αι} — a 
and {δι} — b imply {a, + b,} -~ a+ ὃ. Lete > O be given. Then 


(az + δι) — (α + δὴ) S lax — αἱ + be — δ], 


and, by assumption, we can find integers K,, Ko such that |a, — a] < €/2 for all 


k > Ky, |b, — ὃ] < €/2 for all k > Ky. Thus if K is the larger of K, and Ko, 
we have 


(αν + δι) — ἃ Ὁ δὴ <5 +56 


for all Κα > K, as required. 
To prove (ii) we note that 


Ι 


Ιακδχ - ab| Ιακδχ -- a,b +- a,b = ab| 


lax| [δα — δ᾽ + |b] lax — αἱ. 


lA 


But since {αν} is convergent it is a Cauchy sequence, and therefore is bounded 
from above and from below. (See the proof of Theorem I-2.) Thus there exists 
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a positive constant M such that |a,| < M for all k, and the above inequality can 
be written 
[αμδι πα ab| < Μ|δ, = δ] + [6] [αχ =s al. (I-3) 


Now let € > 0 be given, and choose εὐ K, and Kg such that 


for allk > Κι, and 
δι — δὶ) < say 


for allk > Ko. (If b = 0, the second term in (I-3) vanishes, and we need only 
choose K,.) Then with K the larger of K, and Ky, and k > K, 


εἰ _. 
2|δ]. 


[ακδ. -- ab| <5 = €, 


and we are done. J 


Ι-3 INFINITE SERIES 


In this section we review the elementary facts concerning infinite series of con- 
stants, including several well-known tests for the convergence of such series. 


Definition I-4. Let 
>) & = αι baa - τ +a t+: (I-4) 
k=1 


be an infinite series of real numbers, and let {5} be the associated sequence 
of partial sums 
51 = αι, 


αι + Qa, 


I 


So 


δ. = Ay + do ters + a. 


Then (I-4) is said to converge to the value a if and only if {s;,} converges 
to a. In this case we write 


= 2) a 
k=1 
and say that a is the sum of the series. Otherwise, (I-4) is said to diverge. 


Perhaps the most familiar example of a convergent infinite series is the geometric 
series 


ag + aor + aor? + °°, (I-5) 
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whose ratio r satisfies the inequality —1 <r < 1. Indeed, in this case 


So = 40; 
δ1 = σοί Ἔ 7). 
Sh = ao(l + r+ ») + aa + 7), 


But, by the identity 


we have 
k++ 
κι = ay > r £1, 
and it follows that 
: _ ao 
pe ieee 


provided |r| < 1. On the other hand, if |r| > 1, the sequence {s;,} is divergent, 
and hence so is (I-5). 


EXAMPLE 1. The real number 0.33333... is the sum of the geometric series 


3 3 3 
10° 102 102 © ’ 


whose ratio is τς. In this case the formula given above for limz_,. 8. yields 


mm _3, ! 1 
l1—r 10 j 3 


τς s 
10 
as expected. 


The question of convergence or divergence for geometric series was settled in 
the most satisfactory way possible, namely by obtaining a simple closed-form ex- 
pression for δ. and letting k tend to infinity. The existence of such a formula for 
s, and the ability to find the actual sum of the series is something of an accident, 
however, and for this reason we now turn our attention toward deriving conver- 
gence tests which may be applied directly to the terms of a series. We begin by 
restating Theorem [--2 in a form appropriate to series. 


Theorem ἰ--4. The series >-;—, a, converges if and only if for eache > 0 
there exists an integer Καὶ, depending on ε, such that 


γι 
24 4 


k=m 


«ε ([-6) 


whenever K < μι <n. 
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In fact we note that the expression >-;—,, a; is just the difference 5, — 51 of 
the partial sums s, and s,,_,. Hence the theorem states that }";_, a, converges 
if and only if its sequence of partial sums is a Cauchy sequence, and this is the 
content of Theorem I-2. J 


Theorem I-4 provides a general convergence criterion for series, but unfor- 
tunately it is difficult to apply in practice. We devote the remainder of this section, 
therefore, to the derivation of several consequences of the theorem which, although 
lacking the generality of Theorem I-4, do provide convenient tests for convergence 
in a large number of cases. 


Theorem I-5. Jf Σ χα a, converges, then limyn_,. Qn = 0. 


Proof. Since 


ἅμ! Ἐπὶ Sn ae Snails 
the theorem is an immediate consequence of Theorem I-4. J 


It is useful to restate the last result in the following form: Jf a; does not tend to 
zero ask --» οὐ, then Σ᾽ χες a; diverges. Thus each of the series 


cc n οΌ ; w es 
δ π᾿ aan > (1 +4) 


n n=l 


diverges, the first because lim,_,.. 1/(1 + n) = 1, the second because lim,_,.. (sin 7) 
does not exist, and the last because 


1\" 
tin(1 +3) τὸ 


It must be emphasized, however, that the converse of Theorem I-5 does not hold, 
for, as we shall see presently, the so-called harmonic series 


8 


I 


eae aa εὐ μὰ 
k=l 


Ι 


diverges, although lim;_,. 1/k = 0. Thus even though it is necessary that 
lim,_,. ας = Oin order that Σ χε- a, converge, this condition is not sufficient. In 
the next three theorems we restrict our attention to series whose terms are positive. 


Theorem I-6. (Comparison test.) Let Σ χει a, and >’ ,= by be series with 
positive terms. 


(1) If f-1 a, converges and b, < a, for every k, then Σ και 6% also 
converges. 
(2) If χε a diverges and bj, > a, for every k, then d°,=1 by also diverges. 
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Proof. (1) Since δὲ > 0 for all k, the partial sums of Σ᾿ χες b; form a monotoni- 


cally nondecreasing sequence. But this sequence is also bounded from above, since 
nr γι oo 
doe S Dia S Σ᾽ αἱ = 8, 
k=1 k=1 k=1 


where S denotes the sum of the convergent series >>;—, az. Hence by Theorem I-1 
the sequence of partial sums of >°;—, 5; converges. 

(2) In this case Σ᾿ χε δὲ > Σ χει ay and it follows that these partial sums are 
unbounded since otherwise the series > .χ-- a, would converge. J 


Theorem I-7. (Ratio test.) Let Σ᾽ χα a, be a series of positive terms and 
suppose that 


exists. Then 


(1) Σῖκει ax converges if L < 1, 
(2) Σ κει a, diverges if L > 1. 


(Note that no assertion is made in case L = 1.) 


Proof. (1) Suppose that L < 1 and that r is chosen to be a fixed real number 
with L <r < 1. Then for sufficiently large values of n, say n > N, we have 
Qn41/An <r. Thus 


an41 < ray, 


< 
Ων. < rave, < r°an, 


γίαν. 


lA 


aN +k 


But since r < 1, the geometric series Σ κπτ αν γῆ converges. Thus by the com- 
parison test so does 


ie] οο 
Dy ἄν = Dy a, 
k=0 k=N 


and hence also the given series Σ᾿ χεὶ ax. 
(2) The proof of this case is similar: this time Σ᾿ χε a, is compared with a 
divergent geometric series (ratio r > 1). We omit the details. ἢ 


Theorem I-8. (Integral test.) Let }°¢—, a; be a series of positive terms and 
assume that there exists a function f, continuous and monotonically nonin- 
creasing on 1 < t < οὐ, such that f(k) = a, for k = 1,2,.... Then 
the series Σ χει ay and the improper integral ire f(t) dt converge or diverge 
together. 
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Proof. Assume first that [ | f( dt converges. Then a reference to Fig. I-I(a) 
makes it clear that 


n n+l Ὁ 
2) % S | Κὸ αἱ < | f(t) dt. 
k=2 Ι 1 


Thus the partial sums }°%_, a, of the given series form a monotonically nonde- 
creasing sequence which is bounded above by the real number a, + te F(t) dt. 
Convergence follows from Theorem I-1. 


FIGURE I-1 


If, on the other hand, the integral {; f(‘) dt diverges, then the partial sums 
> λς a, are unbounded, for in this case (see Fig. I-1b) 


ὴ n+l 
Saf! Kode 
k=1 1 


and the latter integral tends to infinity asn — o.] 


--. = Ἢ = + = +- eee 


n 


n=1 
diverges, for the integral test may be applied in this case with f(t) = 1/t to obtain 


dt _ im | ee lim (Ina) = o. 
t 1 ὦ 


1 an a— 


More generally given any p-series Σ χε. 1/k”, p a positive real number, we have 


[ dt Pd goer ; 
— = ji t~? dt = lim ————— , ~ |, 
co? See 1 ao — P 7 Ι ᾿ 
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and since this limit exists if and only if p > 1, it follows that a p-series 
> p=; 1/k? converges if p > 1 and diverges if p < 1. In particular the series 


converge, while the series 


diverge. The p-series and the geometric series constitute useful classes of series 
for which the question of convergence is completely settled. By using these series 
together with the comparison test, a large number of additional examples may be 
treated. 


EXAMPLE 3. The series 


ας 


: = eee oe 
D HEED 7 Vo 


δ 


converges by comparison with the series 


for 1/k(kK + 1) < 1/k? fork = 1,2,.... 


EXAMPLE 4. Consider the series 


ao 


atts Se ita vt 


k=0 
Since 
Pas 2 Bh τος Os Cana 
(kK + 1)! 1:-2-3---(kK + 1) τ 2. 


the given series converges by comparison with the geometric series >~/~-» (4)*. 
Note that the ratio test may also be applied in this case, since 


1 de Ula «. tex. — 
ae ὑπ ee 


EXAMPLE 5. Apply the ratio test to the series 
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Computing lim;z_,. @c41/ax, we have 


(1 Ὁ 1 Vl. Ge ε΄. oi! 


in ..0ΌῸ-ὕβς. οὐ τὺ σοῦ ς- 
θὰ kk/k! eae (k + I)! 
a (ke + 1)} 
~ 


Hence the series diverges. 


EXAMPLE 6. For any p-series we have 


a, Hk OAS ow gn Yo: ( k y = 
πὸ σῶν τυ" δε. τὸ 


Since such series converge if p > 1 and diverge if p < 1, the ratio test cannot 
_ possibly give any information in the case L = 1 (see Theorem I-7). 


I-4 ABSOLUTE CONVERGENCE 


The sequence of partial sums associated with a series whose terms are positive is 
monotonically nondecreasing, and hence the series converges or diverges accord- 
ing as the sequence is bounded above or not. For more general series, however, 
the question of convergence depends much more delicately on the magnitude and 
distribution of the positive and the negative terms. In this section we treat series 
which are absolutely convergent and series whose terms alternate in sign. 


Definition I-5. The series >-;_; a; is said to be absolutely convergent if 
the series Σ΄ χα |a,| converges. 


Theorem 1-9. Jf Sof; |ax| converges, then so does Σ κι 4x. Briefly, ab- 
solute convergence implies convergence. 


Proof. Under the assumption that }°7_; |a,| converges, we shall show that the 
partial sums of Σ᾿ κι a; form a Cauchy sequence. But this follows immediately 
from the relation 


< ᾿Ξ la], πι “ ἢ, 


k=m 


2, ὧι 
k=m 
because the right member can be made arbitrarily small by choosing m sufficiently 
large. ἢ 


Since many important tests for convergence of series apply directly only to 
series whose terms are positive, Theorem I-9 provides a way, sufficient for many 
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applications, of applying these tests to arbitrary series. The ratio test for instance, 
now takes the following form: 
Theorem I-10. (Ratio test.) Assume that the limit 


Qn4+1 


117 


L = lim 


TL —>0O 


exists. Then 
(1) dop-1 a converges if L < 1, and 
(2) Σ κει a, diverges if L > 1. 


If L = 1, no information is obtained. 


Proof. If L < 1, Theorem I-7 asserts that Σ᾿ αν |a,| converges; that is, }°,—1 a 
converges absolutely. Hence, by Theorem I-9, }°;_1 a, converges. 


If, on the other hand, 
Qn+1 


nr 


L = lim 


1 {to 2°.) 


el, 


then |a,41| > |a,| for sufficiently large n. Thus a, does not tend to zero asn — oo, 
and > >,—1 a, diverges. JJ 


EXAMPLE 1. Determine the set of values of x for which the series 


Eve)" = - Θ΄ +2G) 3G) + 


converges. 
Since a, = (—1)*k(x/2)**, we have 


An +1 ay ee) i 2 Ἐξ} _ n+ i)x|* 
An (— 1)"n(x/2)8" n 2 " 112 
Hence 
tim ἄπει = jim 24 12) _ lay’, 


and the given series converges if |x/2|? < 1 and diverges if |x/2|*? > 1. Thus 
the series converges for values of x lying in the interval 


--2« xX <2 


and diverges if |x| > 2. Finally, in order to determine the behavior of the series 
at the points x = -+2, we note that the general term becomes +(—1)*k in this 
case, and since this quantity does not tend to zero as k — οὐ, the series diverges 
at both points. 
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It is an unfortunate fact that a series may converge without converging abso- 
lutely, and for such series, usually referred to as conditionally convergent series, 
the tests for convergence which we have devised so far are of no use. This situation 
is illustrated, for example, by the alternating harmonic series 


00 - 1/1 
ΤἈΝ 
k=1 


whose partial sums do approach a limit (see Theorem I-11), despite the fact that 
the corresponding series of absolute values is divergent. This example 1s typical 
of alternating series where we have the following useful criterion for convergence. 


Theorem I-11. Jf the terms of the series Σ΄ χει a, alternate in sign and satisfy 
(i) [αι] > |ae| > lasl > °° -, 
(ii) lim |a,| = 0, 
ko 


then the series converges. Moreover, if S is the sum of the series and S, is 
the nth partial sum, then 


|S — Srl < |apl. 


Proof. We may assume that the terms aj, a3, a5, .. . are all positive and the terms 
Ao, 44, Ag, ..- are all negative. Then 


2n+1 2n—1 
Son41 = > ay = a, + (don = Aon+1) 
1 


k=1 k= 
-- Son—1 + (don + Qon+1) 
< Son—15 


since den + densi < 0. Likewise 


2n 2n—2 
Sen = ΝΣ ay = >»; ay + (don—1 + en) 
k=1 k==1 
= Son—2 + (Gon—1 ἘΝ 5} 


= Son—2s 


since don_1 + don > 0. It follows that the odd-numbered partial sums form a 
nonincreasing sequence bounded below by Se, and that the even-numbered par- 
tial sums form a nondecreasing sequence bounded above by S, (see Fig. I-2). 
Thus each of these sequences possesses a limit, say 


lim Sok = Sz and him Sok41 = So, 


k— 00 
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where clearly Sz < So. But in fact since 

lim S44 - ΝΥΝ ΞΞ lim |a;,| = 0, 

k— ὦ — 0 
we conclude that Sz = So, and the common limit S is the desired sum of the series. 
Moreover from the inequalities . 


Sor < S < S54, (for every k, ἢ), 


we find that 
| |S = Sox < |Son—1 “=e Sox rs [458]: 


and 
|S = καὶ < [5 χ. 1 = Sox = ldox+1ls 


completing the proof of the theorem. J 


FIGURE |-2 


(1-7) 


to show that it converges absolutely if |x + 1; < 1 and diverges if |x + 1| > 1; 
that is, the series converges absolutely for values of x in the interval —2 < x < 0. 
At the endpoints of this interval the ratio test gives no information. However, if 
we substitute x = —2 and x = 0 into the series, we obtain 


So, et δς 3νς 
Af 2k + | a 2k ἘΠΕῚ 


respectively. The tirst of these series converges since it is an alternating series 
whose general term tends to zero (the absolute values tending monotonically to 
zero), while the second series diverges. Thus the given series (I-7) converges for 
values of x in the interval —2 < x < 0 and diverges for x outside of this interval. 
We close this section by stating without proof an important property of abso- 
lutely convergent series which is not shared by conditionally convergent series. 


Theorem I-12. Jf Σ᾽ κι a, is absolutely convergent and if Σ κι by, is any 
series obtained by rearranging the terms of >-;,—1 ax, then Σ᾽ κι. by also 
converges absolutely and has the same sum. 
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I-5 BASIC NOTIONS FROM ELEMENTARY CALCULUS 


Before considering sequences and series of functions in Section I-6, we recall 
some of the basic facts concerning continuous and differentiable functions to 
which reference was made in the text. We shall give no proofs in this section 
although such proofs can be readily based upon the deeper properties of the real 
number system described in Section I-1. For a complete discussion the reader is 
referred to any text on advanced calculus (e.g., W. Kaplan, Advanced Calculus, 
Addison-Wesley, 1952). 


Definition 1-6. A real valued function f defined on an interval J of the 
x-axis is said to be continuous at a point xq in 1 if for every € > 0 there 
exists a 6 > 0, depending in general on € and x9, such that | f(x) — f(xo)| < ε 
whenever x is in 7 and |x — xo| < 6. If f is continuous at every point 
of J we say that f(x) is continuous on I. 


This is the familiar notion of continuity basic to any elementary calculus course. 
Not usually introduced at that level, however, is the following notion of uniform 
continuity. 


Definition I-7. A function f is said to be uniformly continuous on an in- 
terval 1 if for every € > 0 there exists a 6 > 0, depending in general on ε 
but not on x, such that |f(x1) — ἢ (53) < € whenever x), X2 are in J and 
Ixy — Xe] < ὃ. 


It is clear that a function which is uniformly continuous on an interval is also 
continuous on that interval. The following example shows, however, that the 
converse is false. 


EXAMPLE 1. Let 
f(x) = 1/x, O< x <1; 


let x9 be any point in this interval, and let € > 0 be given. If x > x0/2, then 


Lo 


3 el < 3: χ — χρί. 
Xx Xo 2 


If, further, |x — χρί < (x2/2) ε, then 


Thus with 


the conditions of Definition I-6 are satisfied, and f(x) 


= 1/x is continuous at xo. 
It follows that f is continuous in the interval 0 < x < 1 


However, the given 
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FIGURE [-3 


value of ὃ depends on both ε and xo, and a glance at Fig. I-3 convinces us that 
this is necessarily the case. For if any € > 0 is given, the points x’, x’’ in the figure 
can be made to fall as close to x9 as desired by simply choosing x9 sufficiently 
close to 0. Since ὃ must be chosen no larger than |x9 — x’|, this shows that it 
cannot depend solely on ε. Thus f is not uniformly continuous on 0 < x < I. 
It is not hard to show, however, that the difficulty in this example is caused by 
the fact that the interval Ὁ < x < 1 under consideration is not closed. This is 
a consequence of the following general theorem. 


Theorem I-13. Jf f(x) is continuous on a closed interval a < x « ἢ, then 
it is uniformly continuous on that interval. 


All of the above notions extend readily to functions of several variables. We 
state them here for reference. 


Definition I-8. A real valued function f(x;,..., Xn) defined in a region 
D of R" 15 continuous at the pointy = ()1,..-, Yn) of Dif for every € > 0 
there exists a ὃ > 0, depending in general on € and y, such that 


f(x) — f(y)! = "Κα,, - ++ 5 Xn) — fi. - +5 Yn) < € 
whenever X, y are in D and 
IIx — γῇ 3 ν (x1 — yy)? + ee + (Xn = Vane < 6. 


We say that fis continuous in D if it is continuous at every point of D. 


Definition I-9. A function f(x1,..., Xn) is uniformly continuous in D if 
for every € > 0 there exists a ὃ > 0, depending in general on ε but not 
on x, such that | f(x) — f(y)| < € whenever x, y are in D and ||x — y|| < 6. 
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If we consider functions defined on closed and bounded regions D, we have the 
following theorem.* 


Theorem I-14. Jf f(x1,..., Xn) is continuous on a closed bounded region D, 
then it is uniformly continuous on 90. 


Two properties of continuous functions which are of the greatest interest from the 
viewpoint of elementary calculus are given by the next two theorems. 


Theorem I-15. (The maximum-minimum property.) Jf f is continuous on 
a closed interval a < x <b, then it assumes a maximum and a minimum 
value there. More generally, if f(x1,... Xn) is continuous on a closed, 
bounded region D of δι", then there exist real numbers m, M and points 
Υ = ()1,---5Yn)>Z = (2Z1,--+52Zn) in Ὁ such that 


μι “ f(%1,.-+5X%n) ΞΜ 


for every X = (X1,...,Xn) in Ὁ and such that f(y) = m and f(z) = Μ. 


Theorem I-16. (The intermediate value property.) Jf f is continuous on 
the intervala < x < band f(a) # f(b), then for any real number M between 
f(a) and f(b) there is a point x9, a < Xo < ὃ such that f(xo) = M. An 
analogous statement holds for functions of several variables. 


While the student is certainly familiar with the maximum-minimum problem, he 
may fail to recognize the importance of Theorem I-16. Naively, of course, this 
theorem may be used to assert the existence of roots of equations; for example, 
if f(a) < 0 and f(b) > 0 and if f is continuous on a < x < ὃ, then f(xo) = 0 
for some χο in this interval. But on a deeper level, Theorem I-16 15 a consequence 
of the basic properties of the real number system itself and may be interpreted 
as connecting our intuitive notion of continuity with the abstract definition of 
continuity given in Definition I-6. 

Turning now to definitions and theorems relating to differentiation and integra- 
tion, we first state 


Definition I-10. Let f be defined on an open interval containing xo. If 


lim Το Ἔ Ω =. Χο) 


exists, it is called the derivative of f at xo and is denoted by f’(xo) or by 


. * A region Ὁ of ®” is closed if it contains all of its limit points. It is bounded 
if there is a real number M such that for every point x = (x1,...,Xn) of D, 


Ix] = Vai +--+ x2 « Μ. 
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(d/dx)f(xo). If f has a derivative at every point of an open interval 
a< x < b, then fis said to be differentiable on that interval.* 


It is a simple exercise to show that if fis differentiable on an interval a < x < B, 
then it is also continuous in that interval. We state for reference the somewhat 
more important theorem. 


Theorem I-17. (The mean value theorem.) Jf f is continuous in the closed 
interval a < x < b and differentiable on the open interval a < x < b, 
then there exists a point Xo, a < χορ < 6b, such that 


£0) -- Πα), pez), 


The geometric content of this result is illustrated in Fig. I-4. It states that there 
is at least one point in the open interval a < x < b where the tangent to the 
curve y = f(x)is parallel to the secant line connecting the points (a, f(a)), (ὁ, f(b)). 


FIGURE 1-4 


Turning now to integration, we assume that the student already has some 
intuitive feeling for the definite integral [ f(x) dx of a continuous function Κὶ 
A detailed definition would be too lengthy to present here. Nevertheless, given a 
continuous function /, it is useful to recall the following terminology: 


(1) 1: F(x) dx is called the definite integral of f on the interval a < x < Ὁ, 
whereas 


(2) if xo is in the interval a < x < Bb, then the function 


F(x) = if fa)dt, a<x<b, 


is called an indefinite integral of fina < x < ὃ. 
The basic connection between differentiation and integration is provided by the 
Fundamental Theorem of Calculus (Theorem I-18). 


* Later we shall need to extend this notion to include the endpoints of an interval as 
well. 
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Theorem I-18. Jf f is continuous ina < x < band 
F(x) = i f(t) dt 
Xo 
is an indefinite integral of f in a < x < ὃ, then F is differentiable, and 
F(x) = f(x). 


It follows almost immediately from the mean value theorem (Theorem I-17) that 
two indefinite integrals of fina < x < b differ by at most an additive constant. 
Thus we are led to the formula 


[ fe) dx = Fe) -- FO, 


where F is any “‘antiderivative” of fona < x < Bb. 
Finally, we state two properties of integrals to which reference is made in the 
text. 


Theorem I-19. If f is continuous ona < x < b, then 


[fe dx| < [νοὶ de. 


Theorem I-20. (Mean value theorem for integrals.) If f is continuous for 
a< x <b, then there is an XQ in the open intervala < x « ὁ such that 


[fede = ὦ = afl) 


Geometrically, f(x) is the average height of f on this interval. 


I-6 SEQUENCES AND SERIES OF FUNCTIONS 


There are three different notions of convergence studied in connection with 
sequences and series of functions. Two of them, pointwise and uniform conver- 
gence are treated in this section, and the third, mean convergence, is handled in 
Chapter 8 of the text. We assume the elementary material of the preceding sec- 
tions, especially that relating to sequences and series of constants. 


Definition I-11. A sequence { f;,(x)} of functions, each defined on an interval 
I, is said to converge pointwise on 1 if 


lim Si(Xo) 
ka 
exists for each Xg in J. 


The following examples illustrate this definition and point out some of the reasons 
for introducing a stronger type of convergence below. 
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EXAMPLE 1. Let f(x) = x*,0 < x < 1,k = 1,2, 3,... Then for0 < x9 < 1 
we have | 

lim ζχ(χο) = lim x6 = 0, 

k—00 k— 0 


while, when x = 1, limy_,. f,(1) = 1. Hence the given sequence converges 
pointwise on the interval Ὁ < x < 1 to the function 


0 if O<x<i, 
70 = \ if χει. 


(See Fig. I-5.) Note that whereas each of the fj, is continuous on the entire in- 
terval 0 < x < 1, the limit function fis not continuous in this interval (namely, 
it is discontinuous at x = 1). 


(1, 1) 


FIGURE [-5 FIGURE I-6 


EXAMPLE 2. Let f,(x) be the function defined on 0 < x < 2 whose graph is 
indicated in Fig. I-6. Clearly f,(0) = 0 for every k, so lim;z_,. f,(0) = 0. More- 
over if 0 < x9 < 2, then there is some value of k, say K, such that 2/K < Xo, 
and hence f;,(x9) = Ofor every k > K. Thus lim,_,. fi(Xo) = 0, and we conclude 
that {f;,(x)} converges pointwise to the function which is identically zero on the 
interval 0 < x < 2. This time the sequence of continuous functions converges 
to a continuous limit. Nevertheless, the individual functions f;,,, regardless of 
how far out they lie in the sequence, may differ from the limit function f(x) = 0 
by large amounts. The members of the sequence, therefore, are not “approxima- 
tions” to the limit of the sequence in the expected sense of the term. And the 
integrals of the members of the sequence reflect this peculiar behavior by failing 
to approach the integral of the limit function f(x). In fact Ἢ 7(χ) dx = 0, whereas 
(see Fig. I-6) 


2 
—— ee — ε 2 
| rusyax =} yk =k, 


and tend to infinity, not zero, as k — o. 
In order to eliminate this kind of behavior we now introduce a stronger kind of 
convergence, called uniform convergence. 
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Definition I-12. A sequence { f;,(x)} is said to converge uniformly to the 
function f on the interval a < x < bif for every € > 0 there is a positive 
integer K, depending on ε but not on x, such that | f(x) — f(x)| < € when- 
ever k > K and x is in the given interval. 


It is certainly clear that if {f;,(x)} converges uniformly to fona < x < Jb, then 
it also converges pointwise to f on this interval. In the case of uniform con- 
vergence, however, one can choose k so that ; 
Ii 
70) — € < filx) < f(x) + € 


for every x in the interval a < x < 6b. Thus 
f(x) approximates f to within e over the 
entire interval as shown in Fig. I-7. We 
noted in Example 2, that in the case of point- 
wise convergence, none of the members of 
the sequence need approximate the limit 
function in this way. FIGURE I-7 


Theorem I-21. Jf a sequence {fi,(x)} of continuous functions converges 
uniformly to f ona < x <b, then the limit function f is also continuous 
on this interval. 


Proof. We must show that for any x9, a < xo < ὃ, and any e > 0, there is a 
5 > 0 such that |f(x) — f(xo)| < € whenever a < x < ὃ and |x — xo] < 6. 
Now 


If@) — fol = ΓΟ) — AO) + οὶ — Seo) + Seo) — S%o)| 
< (0) — fe)! + ἱκο) — feo)! μι ο) — f&%o)|. (8) 


But since the convergence is uniform, we can choose an integer k so that the first 
and third terms on the right-hand side of (I-8) are each less than €/3 for every x 
in the interval a < x < b. Moreover, since the function ᾧ thus chosen is 
continuous, we can also choose 6 > 0 such that |f,(x) — fi(xo)| < €/3 whenever 
a< x < band |x — χροὶ < ὃ. The desired conclusion is now immediate. ἢ 


Theorem I-22. Jf {f;,(x)} is a sequence of continuous functions which con- 


verges uniformly ona < x < Bb to the (continuous) limit function f, then for 
every x in this interval 


lim [ κί dt = [ * f(t) αἱ, 
kn Ja a 


and this convergence is uniform ona < x < b. 
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Proof. We must show that for any € > 0 there exists a K such that 
[feo at — f fa <e 
whenever k > K and x is in the interval a < x < b. For this purpose, we use 
the uniform convergence of {f;,(x)} to choose K so that |f,(x) — f(x)| « €/(6 — α) 


whenever k > Kanda < x < b. Then 


[ρα — [ foa| 


{ ἼΔΩ -- fo] at 
< [AO -- fol at 


Λ 


ὃ 
« [τῶ -- sola 


ε 


« ὦ -- αὐ, ἃ 


= € 


for every k > Kandeveryxina<x<b.J 


It would be useful to have a result similar to Theorem I-22 which would apply 
to differentiation instead of integration. Unfortunately this is impossible since 
there exist uniformly convergent sequences of differentiable functions whose 
limit function, although continuous, is nowhere differentiable.* The following 
theorem, however, does hold. 


Theorem I-23. Jf {f;,(x)} is a sequence of continuously differentiable func- 
tions which converges pointwise to a limit f for a < x < δ, and if the se- 
quence {f{(x)} converges uniformly ona <x S δ, then f’ exists for all 
x in the interval and 


fx) = lim Ποῦ. 


Proof. Let g be the limit function to which {f{(x)} converges uniformly. Then, 
applying Theorem I-22, we have 


[ sat 


lim “ fit) dt 
him [ΚΟ — fr(a)] 
f(x) — Κα). 


and it follows from the fundamental theorem of calculus that f’(x) = g(x) = 
lim;_,« fy (x), as desired. ἢ 


* See, for example, Rudin, Principles of Mathematical Analysis, McGraw-Hill, 1964. 
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All of the above results may be recast in the context of series of functions rather 
than sequences. As usual we will write 


fo) = Vi fi, a<x<b, (I-9) 
k=1 


and say that the series converges (pointwise) to f, if its associated sequence of 
partial sums converges pointwise to f. The series is said to converge uniformly if 
the same is true of its sequence of partial sums. In this case it follows immediately 
from Theorems I-21 and I-22 that if each term of the series is continuous, then 
their sum f is also continuous, and 


[ hoa = pa [και 


Finally, if each term of the series ([-9) is continuously differentiable, and if the 
series }°;_1fz(x) obtained by differentiating each term is uniformly convergent, 
then 


fi) = Σου. 


The details of these statements are left to the reader. 
In conclusion we establish the following important criterion for uniform con- 
vergence of series. | 


Theorem I-24. (The Weierstrass M-test.) If Σ κοι Mi, is a convergent 
series of positive real numbers, and if >-,—1 f(x) is a series of functions such 
that | fi(x)| < Mj, for every k and every x in the interval a < x < b, then 
> = Sk(X) is uniformly and absolutely convergent ona < x < b. 


Proof. It follows from the comparison test that for any xo in the given interval 
the series >°;_1 f(x) converges absolutely. Thus the series converges pointwise 
to a limit function fona < x < ὃ. Now 


fo — δ fool =| δ A 
k=1 k=n+1 
< >> [μα] 
k=n+1 
< > Μ, 
k=n+1 
k=1 k=1 


and this latter expression tends to zero as n — oo. Since it is independent of x, 
the convergence of Σ ἢ f(x) is uniform. ἢ 
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EXAMPLE 3. Consider the series 


00 2 
Σ ΠΣ = sinx + Sy OR. (I-10) 
Since 
sin k?x l 
@ | 2k 


for all x, and since )77_1 1/k? converges, it follows from the Weierstrass M-test 
that the given series converges uniformly on -- οὐ < x < οὐ. Let fbe the limit 
function; 1.e., 
2. sin k?x 
f(x) = k2 > πρὸ <x < ow. 
heal 


Then by Theorem I-23, 


; 2” sin ΚΙ 
Ὁ dt = foe, 
[τ 2d, ,. 
- εἶ cos k*x 
k=1 es 


If, on the other hand, we differentiate the terms of (I-10), we obtain the series 


οΌ 


Δ cosk?x = cosx + cos4x + τ", (I-11) 


= 
! 
post 


which clearly does not converge for certain values of x. 


I-7 POWER SERIES 


Of particular importance among series of functions are the so-called power series 
3 k 
SS αιχ = Ay t ayx + aox? +-- 


where do, a),..., are constants. Such series enjoy special convergence properties 
which stem from the following theorem. 


Theorem I-25. Jf the power series )-~—0 axx* converges for some value of x, 
say X = Xo, then it converges absolutely for every x satisfying |x| < xo, 
and it converges uniformly on every interval defined by |x| < |x1| < |xol. 


Proof. Since 37_ ἀρχῇ converges, we know that a,x§ — 0 as k — o and hence 
that there exists a number M such that |anx6| < M,k = 0,1,2,.... Now 


662 INFINITE SERIES [ APPENDIX | 


if |x| < |xo|, then we have ‘ 
Jove] < ME 
0 


Thus since the series 779 M|x/xo|* is a convergent geometric series it follows by 
the comparison test that }-;_9 a,x" converges absolutely on the interval |x| < |x|. 
In particular, for any fixed x , |x,| < |xol, the series >°,~o |a,x%| converges. Thus 
for |x| < |x|, we have |a,x*| < |a,x%|, and the Weierstrass M-test implies that 
the series Σ 9 a,x" converges uniformly on ~x; < x < χη. ἢ 


Now for any power series }-;_0 a,x", one of the following is certainly true: 


(1) Soo azx* converges for every value of x. 
(2) So a,x* converges only for x = 0. 
(3) Spo azx” converges for some nonzero value of x but not for all values. 


In the third case the set of positive numbers x for which >~7_9 a,x” converges 
is bounded above, for otherwise, by the theorem, case (1) would apply. Letting 
R be the least upper bound of this set, we conclude that Σ κ- a,x” converges if 
|x| < R and diverges if |x| > R. 

Combining the above cases, we have 


Theorem I-26. For any power series Σ᾿ κι ο a,x" there is a nonnegative 
number R(R = Oand R = οὐ are included), called the radius of convergence 
of the series, such that the series converges (absolutely) if |x| < R and 
diverges if |x| > R. Moreover, if Καὶ is any number such thatO < R, < R, 
then >-j,~0 a,x" converges uniformly on the interval —R, < x < Ry. 


EXAMPLE 1. Consider Σ᾿» (1/k!)x®. Applying the ratio test we have 


[1/(k + 1)}1χ τ 
(1/k!)x* 


|x| 


an ae 


and for any x, this ratio tends to zero as k — o. Thus the given series converges 
absolutely in — οὐ < x < o and uniformly on every finite interval —R, <x < Rj. 


EXAMPLE 2. If for Σ χεο a,x* the limit 


L = lim 


k— 0 


Qk+1 | 
ak 


exists, then the radius of convergence of the series is R = 1/Z. For in this case 
we obtain the ratio 


Ak+1 
ak, 


Ix|, 


k+1 
aAn41XxX a a 
ay,x* 


and this tends to L|x| as k — o. Thus the series converges if L|x| < 1 and 
diverges if |Lx| > 1, i.e., converges if |x| < R and diverges if |x| > R. 
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Theorems concerning differentiation and integration of power series are easily 
obtained from Theorem I-26. 


Theorem I-27. If the power series 
F(x) = Σ ayx" 
k=0 


has radius of convergence R, then f F(x) dx exists for ~-—-R<a<b<R 
and 


pk+t k+1 


[ F(x) dx = ef a,x" dx = Σ aj, > re ees ta ᾿ : (I-12) 


Proof. According to Theorem I-26, the series converges uniformly on a < x < b. 
Hence (I-12) follows from the general results on integration of uniformly con- 
vergent series. J 


Theorem I-28. If the power series F(x) = Σ ρ a,x" has radius of con- 
vergence R, then F’(x) exists on —R < x < Rand 


F(x) = Σ᾽ ka,x*—*. (I-13) 
k=0 


Proof. According to the general theorem on differentiation of series, we need 
only show that the differentiated series (I-13) converges uniformly on every 
interval —R,; < x « R, for which R, < R. For this purpose, choose x, such 
that Ry < x; < R. Then )°7_; a,x} converges absolutely, and hence there is a 
number M such that |a,x{| < M for all k. Then for |x| < Κι, we have 


Ἢ = ἄἰαμ] [x] 


ΚΙαι Εἰ 1 
Μ 
Ἰχῃ» 
Μ 
al 


lkayx” 


lA 


Ro 


k— 
ὌΝ 


However, the series 
k—1 


is) 


Dae τ᾿ 


= 


converges by the ratio test, and the uniform convergence of (I-13) now follows 
from the Weierstrass M-test. ἢ 


Stated informally, the two preceding theorems assert that a power series may be 
integrated or differentiated term by term without affecting the radius of conver- 
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gence. Convergence at |x| = R may be destroyed by differentiation or added by 
integration, however, but this can only be ascertained by examining each series 
individually. 


EXAMPLE 3. Consider the series 


@@) Σ᾽ αἰ Ξ΄Ἐ χΈ χα Ἐ 


00 xh? x? x? x4 
© LeEppery rtratyat 


Each of these series has radius of convergence R = 1, since (a) is a geometric 
series and (b) and (c) are obtained from (a) by integration. We find, however, that 
series (a) diverges at both endpoints x = 1 and x = —I1, series (Ὁ) converges at 
x = —1 but diverges at x = 1, and series (c) converges at both endpoints. 


There are a number of interesting implications of the theorem on differentiation 
of power series. If }°~-9 a,x” converges on —R < x « R, then it represents 
(converges to) a continuous function there: 


F(x) = 2 αρχ΄. 
k=0 
Moreover F’(x) exists on this interval and 
F(x) = Σ᾽ ka,x*', —-R<x<PR. 
k=0 
Repeating the process of differentiation indefinitely, we obtain 
F(x) = SO κά -- Wk -- 2)---- (ᾧ -- π Ῥ 1)a,x"—, 
k=0 

forn = 1,2,3,..., and hence F‘(0) = n!a,. With this we have proved 

Theorem I-29. Jf a function F can be represented by a power series 

> 29 anx® on the interval —R < x < R, then F has derivatives of all 

orders on —~R < x < Raand the coefficients of the series are uniquely de- 

termined by the relation ay = (1/k!)F (0), ag = F(0). 
The theorem asserts the uniqueness of the power series expansion of a function 


F on a given interval —R < x < R. The existence of such a series is a more 
difficult problem, and we investigate it in the next section. We note, of course, 
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that for a function F to have a power series representation it is necessary that 
F have derivatives of all orders. This condition rules out, for example, the 
function In |x| which is not defined at x = 0 and the function x®/? for which the 
third derivative fails to exist at x = 0. Unfortunately the existence of infinitely 
many derivatives of F in —R < x < R is not sufficient to assure the represen- 
tability of F by a power series.* 

We close this section with several arithmetic results on power series. 


Theorem I-30. Jf 
f(x) = δ) ayx" ands g(x) = Σ b,x" 
k=0 k=0 


on —R < x « R, then for any constants a, B the series Σ᾿ κ-- (aay + Bby)x* 
has radius of convergence at least R and represents the function af (x) + g(x) 
on—-R<x< R. 


The proof of the theorem is an immediate consequence of Theorem I-3. 


Theorem I-31. 77 
f(x) = > a,x" and g(x) = > b,x" 
k=0 k=0 


on —R < x < R, then the series Σ χε c,x", where 
k 


Ck = Σ ayby_; = ἀρδκ + ayby_1 +--+ + axbo, (I-14) 


converges tofgin—-R< x « R. 


The reader will note that the coefficients (I-14) are exactly the ones obtained by 
“formal multiplication” of the given series, treating them as polynomials. 

As a final comment, we note that so far we have been discussing power series 
> 4-0 4.x" whose interval of convergence was centered at the point x = 0. The 
entire discussion may be carried through equally well, however, for series of the 
form >°%_1 ax(x — a)*. The interval of convergence for such series is of the form 
a—- R<x<a-+ R (with or without the endpoints) and the radius of con- 


* The function defined by 
ee), x £ 0, 


f(x) = Ἢ es: 
has derivatives of all orders on —1% < x < ©. However, f“(0) = 0 for all n, and 
the series Dro (1/k!)f™(0)x* converges on --οο < x < © to the function which is 
identically zero, not to Κὶ 
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vergence R is computed by the same techniques as before. In particular, if 


2,2) 


f(x) = ΣῚ) a(x — a)" 


k=0 


ona— R< x < a+ R, then f possesses infinitely many derivatives on this 
interval and a, = (1/k!) f(a). 


I-8 TAYLOR SERIES 


In the preceding section we found that if a function f can be expanded in a power 
series as | 


fl) = Σ ax — ay" 
k=0 


in an interval |x — αἱ < R, then fhas derivatives of all orders, and 


] 
a, = af), k =0,1,2,.... 
We consider now the question of existence of such a power series representation 
for a given function καὶ 


Theorem I-32. (Taylor’s formula with remainder.) Suppose that f and its 
first n + 1 derivatives are defined and continuous on the interval I defined by 
[x — αἱ < R. Then for all x in I, we have 


n (k) 
fo) = DEO -- af + Ra, (15) 

k=0 ° 

where . 
R,(x) = “ | (x — fT) dt. (I-16) 


Proof. We begin with the formula 
fe) — fa = [ roa. 


Transferring f(a) to the right-hand side of this equation and integrating by parts 
[with u = f’(t), dv = dt] we obtain* 


70) = f@ + FOO -- Dla — [ἃ -- HPO at, 
OT 


70) = S@ + F@E- α + Ἦ [ὦ -- OF dt 


* Recall that the formula for integration by parts may be written in the form 
fudv = uv +c) — f[@ + ὦ du, where c is an arbitrary constant. 
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Again we integrate by parts, letting u = Κ( 3 (Ὁ) and dv = (x — ὃ dt, to obtain 
fx) = fla) + πῶς — a) +} f%@H- Ξ 3 1. x Ξὸ τ £00 at 


= fa + Pate — a) + πῶς. a + | SS prea 


Continuing to integrate by parts (proof by mathematical induction) we arrive at 
the desired formulas after n integrations. (Note that the integrations can be 
carried out so long as the integrands are continuous.) 


EXAMPLE |. The function f(x) = x®/? has continuous derivatives through order 
two on the interval --οὺ < x « οὐ. Thus, when a = 8, Taylor’s formula yields 


x88 = fB) + ρα -- 8) + [ “(x — ΚΞ dt 


256 + 288(x — 8) + 42 " (x -- 1133 at. 


I 


I] 


If f has derivatives of all orders at the point a, it is only natural to consider the 
infinite Taylor series 


3 £@ (x — a)’, (I-17) 


and ask whether this series converges to f in an interval |x — αἱ < R. Applying 
Theorem I-32 we can assert that (I-17) converges to f whenever |x — al < Rif 
and only if 


lim R,(x) = 
k—~oo 


for every x in the interval. Thus to settle this question it suffices to determine the 
behavior of R,(x) as k — o. To this end the following result is particularly 
useful. 


Theorem I-33. Jf f satisfies the conditions of Theorem 1-32, and if there 
exists a number M such that |f"*?(x)| < M for |x — αἱ « R, then 
Ix νι ἀν 


Proof. Assume first that x > a; then 


(I-18) 


ΚΟ ΟἽ = ἢ | (x — fer) dt 


lA 
|= 
aa 
τ 
| 
ων 
=. 
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If, on the other hand, x < a, then 


Κι, ΑἹ < = a, (t — x)" dt 


Combining these results yields (I-18). § 
EXAMPLE 2. If f(x) = e*, Taylor’s formula yields 
2 n 
=ltxtFte Ἐ τὶ Ὁ RQ), 
with ᾿ 
R,(x) = 1 (x -- t)"e’ dt. 
Ai Jo 


Since | f”*1(x)| = |e?| < e* on the interval |x| < R, Theorem I-33 yields 


ΧΙ! 
|Rn(x)| < εἶ ᾿ Ἐπ’ —-R<x<R. (I-19) | 


Thus for any x in this interval 
lim R,(x) = 0." 


nb 


Since R was arbitrary, it follows that 
2. x* 
ὩΣ, μ᾽ ~» <x < o, (I-20) 


1.6. that e is represented by its Taylor series on the entire real line. 

The estimate (I-19) may be used for computational purposes as well. For 
example, Jet us find the number of terms of (I-20) required to compute e to an 
accuracy of seven decimal places. In this case we have (with R = 1) 


τι => a 2 R,(1) 


and 
3 


1 
ΠΕΡ ΕΝ 


This latter expression may be made smaller than 107 7 by choosing n = 10. 


[Κ,(}} < e 


* For fixed x, the series 00 [5] 


DAG + 1)! 


k=0 


converges by the ratio test. Hence its general term tends to zero. 
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EXAMPLE 3. Since the derivatives of sin x and cos x are each bounded by M = 1 
on —« < x < o, the remainder terms of their Taylor series are bounded by 
ΙΧ} τ λα + 1)!. Thus in each case the Taylor series converges to the respective 
function on the interval —o < x « οὐ. The reader can easily show that the 
resulting series are 


est oe 4 x 
sinx = xX -- τ 51 ; 

7 x? n x? 

eat rr a 


EXAMPLE 4. Combining Example 2 with Theorem I-30, we obtain 


3 5 
sinh x = μον ὦ li 


coshx = ἐ(ο" +e“) = 145 τ. ἯΞ 


Ι-9 FUNCTIONS DEFINED BY INTEGRALS 


The definition of functions by integrals is in many ways analogous to their defini- 
tion by series and in this section we consider the problems of differentiating and 
integrating such functions. 

Let the function f(x, 2) be defined and continuous on the rectangle R:a<s <b, 
c <¢t<d. Then the integral ifs f(s, t) dt exists for a < s < 6 and defines a 
function F(s). 


Theorem I-34. Under the conditions stated above, the function 


F(s) = [ f(s, ἢ dt 


is continuous ona < s < b. 
Proof. We have 


Fo +h) -- FO =| [UGH AD — fooler 


lA 


[ f(s + h,t) — f(s, 2] dt. 


Since f(s, ἢ) is uniformly continuous on the rectangle (see Theorem I-14), we 
can, for any € > 0, find a 6 > O such that | f(s + A, 1) — f(s, 2] < €/(d — ©) 
whenever |h| < ὃ and both 5 and s + hare in the given rectangle. Then |h| < ὃ 
implies that 


d 
ε 
\F(s + h,t) — F(s)| < | godt τ ε 
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We next ask if F(s) is differentiable and if the natural formula 


“ad 
0 
“ Σ mis: 
Fs) = / τς f(s, t) dt 
holds. With mild restrictions this turns out to be true. 


Theorem I-35. Jf f(s, t) is continuous in R and if df/ds exists and is con- 
tinuous in R, then 


d d 
Fs) = a f(s, t) dt = / < f(s, t) dt. 


Proof. We calculate 
: d 


ΗΝ + h) — F(s)] = | ΗΝ + h,t) — f(s, 1)] dt. 
By the mean value theorem 


0 
FLfs + het) — fos, o1 = ὅ Ὁ + oh, 0), 
where θ is some number between 0 and 1. Thus 


d 
PO im FF) — Ae) — lim | of (Gods 
h->0 : c δ 


h-0 
and since df/ds(s, t) was assumed to be continuous, Theorem I-34 yields the de- 
sired result. ἢ 


The formula of Theorem I-35 can be extended to allow variable limits on the 
defining integral, as follows. 


Theorem I-36. Let f(s, t) and odf/ds be continuous on the rectangle 
R:a<s< b,c < t < ὦ, and let c(s) and ds) be continuously differenti- 
able functions with range in the inter- 
vale “1 < d (see Fig. I-8). Then 


t 


d(s) 
d d 
Re ae - f(s, t) dt 


d(s) 3 
| ΟΥ̓ ἐν t) dt 


(s) Os 


+ f(s, d(s)) 4 6) 
— f(s, c(s))e’(s). FIGURE μι 
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Proof. Let G(s, u, v) be the function defined by 
G(s, u,v) = [ f(s, t) dt. 


Then F(s) = G(s, c(s), d(s)), and the chain rule for functions of several variables 
yields 


FG) = Ὁ (s, c(s), d(s)) + 90 (s, e(s), d(s))e"(s) 


+ 52 (s, e(s), d(s))a"s). (I-21) 


But by the fundamental theorem of calculus 
0G 
OD (s, c(s), d(s)) = f(s, d(s)), 


27 (s, es), ds) = — f(s, 60), 


and application of Theorem I-35 yields 


d(s) 
96 (, e(), 40} = f apf Dat 


These equations together with (I-21) give the desired formula known in the liter- 
ature as Leibnitz’s formula. ἢ 


We now turn our attention to improper integrals and let f be piecewise con- 
tinuous on 0 < x < o (see Section 9-2). 


Definition I-13. The improper integral fo F(x) dx is said to converge if the 
limit 

B 

lim 1 f f(x) dx 


exists. More precisely, the given integral is said to converge to L, and we 
write L = fo I(x) dx, if for every € > 0 there is a positive number ΗΜ 
(depending in general on €) such that 


B 
LL - | f(x) ἀκ < € 
0 
whenever B > M. 


In a similar fashion, [΄- J (x) dx is defined for a piecewise continuous function 
on —0o < x < οὐ, by the double limit 


lim 


Anne ic f(x) dx. 
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Now if Ie. f(s, t) dt exists for every value of s in an interval J, then it defines a 
function 


F(s) = [ ” f(s, t) dt 


on this interval. The situation here is analogous to that which arose in defining a 
function as the pointwise limit (sum) of an infinite series; for example the con- 
tinuity of f(s, ἢ) on the region 0 < t < οὐ, 5 in J, does not imply the continuity 
of F(s) on 1 For this reason we extend the notion of uniform convergence, as 
follows. 


Definition I-14. The integral iP f(s, t) dt 15 said to converge uniformly to 
F(s) on J if for every € > 0 there is a positive number M, depending in 
general on ε but not on s, such that 


B 
Fs) ~ f° 60 dt < € 
0 
whenever B > M and sis in J. | 
If F(s) = fo Ff (s, t) dt uniformly on 1, then the integral fe {(6, t) dt may be viewed 
as approximating F(s) on this interval (see the corresponding discussion concerning 


uniform convergence of series). Moreover we have 


Theorem [--37. Jf f(s, t) is continuous for s in 1 andOQ < t < ow, and if 
F(s) = if f(s, t) dt converges uniformly on I, then F(s) is continuous on I. 


Proof. Given e > 0, choose B > 0 so that 
B ε 
F(s) -- , ἢ dt - 
Fs) — fo fs. dt] < 3 


for every sin J. Then 


B 
IF(s + h) — F(s)| «οτὼ- { fs + hat 


B B 
ΕΝ fis + hyd [οὐαὶ 


B 
oe | f(s,.t) dt — F(s) 
0 


B B 
Zeal fis +h yar — | fs, ἡ dt] 
0 0 


Now choose ὃ > Ὁ so that the latter term is less than €/3 whenever [ἢ| < 6. 
(Theorem I-34 provides such a ὃ.) J 
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The problem of integrating a function of the form 
F(s) = i ” f(s, t)dt, sin J, 
0 


forces us to consider the question of interchanging the order of integration in 
iterated integrals. We recall that for the finite rectangle R:a < s< bc <t<d 
we always have 


gece Nae [ [4% ἢ) ds dt 


(provided, of course, that fis continuous). However, this result is in general false 
if the integrations are carried out over unbounded intervals. To examine this 
situation more closely, we must define what is meant by improper double integrals 
and explore their relation to the improper iterated integrals. 


Definition 1-15. Let R be the first quadrant of the s, 1 plane. We say that 
the improper double integral 


[ [ f(s, t) ds dt 


converges to L if for every € > 0 there is a positive number M such that 


IL - [ [κορὰ αι < € 


whenever A, B are both greater than M. (Analogous definitions are given 
when R 1s a half-plane or the whole plane.) 


Thus if we let 
B ,Α 
F(A, B) = , t) ds dt, 
(4,B)= ff” fis t)ds 
then 
(1) the double integral [Jr f(s, t) ds dt is the double limit 
lim F(A, B); 


,Α4--» 
Β--ὦ 


(2) the iterated integrals are given by the iterated limits 
[ ΄- I (s, t) ds dt im lim F(A, B), 
0 Jo 


Ι 
Bow Ao 

: i ” f(s, t)dtds = lim lim F(A, B). 
0 0 A—-0 Boo 


Ι 


The question of equality of the three integrals is then just a special case of the 
corresponding problem for limits. Thus the following result is of interest in this 
context. 
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Theorem I-38. Let the double limit L = lim4_,0,B-.© F(A, B) exist; i.e., 
assume that for every € > 0 there isan M > O such that |L — F(A, B)| < ε 
whenever A > M and B > M. 


(1) Jf limy_,. F(A, B) = L(B) exists for every B, then 


lim L(B) = L. 
Baw 
(2) If limg_,. F(A, B) = L(A) exists for every A, then 
lim L(A) = 1. 
Aa 


Proof. It suffices to prove (1). Now 
IL — L(B)| < |L — F(A, B)| + |F(A, B) — LB). (I-22) 


Thus, given ε > 0, choose Μ᾽, so that |L — F(A, B)| < €/2 whenever A > M, 
and B > M,. Nowif B > M, is held fixed we can find an M > My, such that 
|F(A, B) — L(B)| < €/2 whenever A > M. Hence |L — L(B)| < ε, and since 
this can be done for any B > M,, the proof is finished. J 


Restated in terms of integrals, Theorem I-38 asserts that if the double integral 
L = ffr f(s, t) ds dt exists, then the existence of fo J (s, t) dt for every s implies 
that the iterated integral Te. ips (6, t) dt ds exists and equals L (and similarly with 
the opposite order of integration). More interesting, however, is the converse 
problem of inferring the existence of the double integral from the existence of one 
of the iterated integrals. For this, the notion of uniform convergence enters once 
again, and we accordingly restate Definition I-14 in a form appropriate to limits. 


Definition |-16. F(A, B) converges uniformly to L(B) as A — o if for 
every € > 0 there is a number M > Ὁ (which depends in general on ε 
but zot on B) such that 


|F(A, B) — L(B)| < ε 
whenever A > M. 


We can now state the main result. 


Theorem I-39. Suppose that F(A, B) converges uniformly to L(B) as 
A — ow, and that L = limg_,~ L(B) exists. Then 


(1) lim4_,0,B 50 F(A, B) = L, and 
(2) if limg_,. F(A, B) = L(A) exists for every A, then lim4_,. L(A) = L. 
Proof. (1) We have 
|L — F(A, B)| < |Z — L(B)| + [L(B) — FU, B). 
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Given ε > 0, choose M, so that the first term on the right-hand side is less than 
€/2 whenever B > M, and choose M, (using uniform convergence) so that the 
second term is less than €/2 whenever A > My. With M = max {M,, M2} we 
have |L — F(A, B)| < € whenever A, B are both greater than M. (2) The 
second result now follows from Theorem I-38. J 


For the special case of improper iterated integrals, the above theorem takes the 
following form: 


Theorem I-40. Jf the integral f is J(s, t) dt converges uniformly, and if the 
iterated integral 


L= [> [ sG,atds 


exists, then the double integral also exists and satisfies 
[ f(s, t) ὦ dt = Γ [ f. t) dt ds. 
R ο Jo 
If, moreover, the integral f - I (s, t) ds also exists, then we have 


[ [ £ t) ds dt = [ [fe 1) dt ds. 


Corollary. Jf f(s, t) is continuous ina <s <6b,0 <t < ow, andif 
Fs) = [" fs, dt, as <b, 
0 
the convergence to F(s) being uniform ona “ 5 < b, then 
b b ra 0 fb 
F d. = = : 
[ (s) ds i [ f(s, ἢ at ds [ [ f(s, t) ds dt 
Proof. We need only apply the theorem to the function f(s, 2) defined on 


O< s<w,0<t < @ by 


ifa<s<b, 
otherwise. 


fs, t) =) t), 


For then Ps f(s, ὃ dt converges uniformly on Ὁ < s < o to the function 


a,  |F(s) ifa<s <b, 
fOs A otherwise, 
and 


[ fends = [της = [' fs, 04s 


exists. ἢ 
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The above theorems treat the problem of integrating functions defined by im- 
proper integrals. A useful result concerning the differentiation of such functions 
is the following: 


Theorem I-41. Jf df/ds(s, ἢ) is piecewise continuous ona < s < ὃ for each 
t, and if 


F(s) = | I (s, ὃ dt and j ice. t) dt 
0 0 Os 
both converge uniformly ona “ 5 < ὃ, then 
Pcs ae 
Fs) = Ι a6 (s, t) dt. 


Proof. Let H(s) = [0 af/ds(s, t) dt. Then 


[ wa-[ [ Looae= {0 { Lona 


Ι [{(, t) aa f(a, t)] dt 
F (u) τ (a), 
whence H(u) = F’(u) by differentiation. J 


I 


One of the main examples in the text of a function defined by an integral is the 
Laplace transform 


sifls) = [ “ε΄ δ  ἀϊ = F(s) (I-23) 
0 
of a piecewise continuous function. Since f need not be continuous, the uniform 


convergence of (I-23) (established below) is not sufficient to establish the continuity 
of F(s). However, for functions f of exponential order, we have, for h > 0, 


Fs Ἔ 1) — FO) = | fee! — ef αἱ] 
0 
= | | i  Ξ De"'f(t) dt | 
0 
« [ἃ ee fo) at. 
Thus if a, M are any constants chosen so that [f(2)| < Me*’, it follows fors > a 


that : 
\F(s + h) — F(s)| < M [ ( -- em ye @—9! ay 
0 


1 Ι 
ul + - 2.1 - 
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and hence that F(s + h) — F(s) tends to zero as h — Ὁ through positive values. 
A slight modification of the argument yields the same result if h — 0 through 
negative values, and therefore the continuity of F(s) 15 established for s > a. We 
have thus proved the following theorem. 


Theorem 1-42. Jf f is piecewise continuous on Ὁ < t < o and is of 
exponential order, and if ag is the greatest lower bound of the set of real 
numbers a for which |f(t)| < Me’ (for some constant M), then ΘΓ] is 
continuous ΟἿ ἂρ < 5 < ο. 


Finally, we justify the formula 


dad" as dad" ᾿ —st — (_1\" : n —st 

Fn “1 = | e f(t)dt = (-- 1}. : t"e” f(t) dt 

given in Section 5-5 of the text by showing that each of the integrals 
[ 1. δ (0 dt, n = 0,1,2,..., (I-24) 
0 


converges uniformly on a < s < οὐ where a > ao (see Theorem I-42 for the 
definition of ag). In fact, choosing 51: (a9 < 5; < a) and M 80 that 
If@| < Me*', we have, for s > a, 


[ γε ἡ f(t) de | < ΜΙ Ὁ dy 
A A 
< Μ᾽ te (0 dy, 
τ Α 


But the last expression tends to zero as A — οὐ (f” 15 of exponential order), and 
since it does not depend on 5, the uniform convergence of (I-24) ona < s < w 
is established. In view of Theorem I-41, any number of differentiations of £[/](s) 
may be performed by differentiating under the integral sign. 


* The number ao, sometimes called the order of f, is greater than or equal to the 
abscissa of convergence so of f. As was shown in the text proper, however, we may 
have So < ao. 
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lerch’s theorem 


Let f(t) be defined on 0 < t « οὐ, and be piecewise continuous on every finite 
interval Ὁ < ¢ < A. Assume, moreover, that f(t) is of exponential order, i.e., 
that there exist constants a and M such that |f()| < Me*',0 < t < o. It is 
the purpose of this appendix to demonstrate the following theorem. 


Theorem. (Lerch’s theorem.) /f £[f](s) = (Pe e—* f(t) dt is identically zero 
for alls > 50. Sg Some constant, then f(t) is identically zero (except possibly 
at its points of discontinuity). 


Proof. Let ¢(s) = fo e~**f(t) dt, s > so. Then if 


P(x) = 2 ax" 


k=0 


is any polynomial with real coefficients, we have 
| e Ῥ(ο δ) f(t) dt = / e > ae" f(t) dt 
0 0 k=0 
=> a} ee“ f(t] dt 
k=o δ 


= >) ab(s + k)=0, s > So. 
k=0 
Making the change of variable x = ο΄, this last condition transforms to 
1 

[ x° P(x) f(—In x) dx =0, 5s > 50. 

0 
Now choose a fixed s; > max 50, 1,α + 1}. Then 

x1) F(—In x)| < Μχ'ι 1ραί--ἰπ 4) τῷ Μχιι τὺ 


and it follows that the function 


G(x) = χι 'f(-Inx), 0< x <1, 
678 
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tends to zero as x — 0. Let us define G(O) = 0, thus making G continuous at | 
x = 0. Then G 15 a function which is bounded in the interval Ὁ < x < 1, has 
only “jump” discontinuities in this interval (although there may be infinitely many 
such discontinuities), and satisfies : 


[  G(x)P(x) dx = 0 


for every polynomial P. We shall deduce from these conditions that G(x) = 0 
for 0 < x < 1 (except possibly at its points of discontinuity). In fact, let us 
choose a complete orthogonal basis for the vector space @e@[0, 1] with inner 
product f-g = Ἕ 7Οὴ)ρ(χ) dx.* Then any piecewise continuous function g 
which satisfies 


[ * g(x)P(x) = 0 


for every polynomial must be identically zero (except where it is discontinuous), 
for it is orthogonal to every member of the chosen basis and hence must be the 
zero vector in @E[0, 1]. 

Except for the fact that G may have infinitely many discontinuities, the proof 
would be complete. Fortunately, it is not difficult to show that a complete ortho- 
normal basis for ΦΟΙΌ, 1] is also a complete basis for the slightly larger class of 
functions which, like G, may have infinitely many jump discontinuities but are 
bounded.f We thus conclude that G is identically zero wherever it is continuous, 
and hence since G(x) = x*:~1f(—In x), the same must be true of f. ἢ 


* We may choose, for example, the even-numbered Legendre polynomials as such a 
basis. For if 


1 
[ σι )Ρωκα) ἀκ = 0, k = 0,1,2,..., 
0 


then for the even extension g of ἴο —1 < x < 1, we have 


| 


1 
[ 2(x)Pr(x) dx = 0, μ =0,1,2,... 
| 
Thus the piecewise continuous function g must be zero (except at its points of discon- 
tinuity) and hence the same is true of g. 
Τ The function G(x) is, in fact, piecewise continuous in every interval 4 < x < 1 
(for 0 < A < 1) and is continuous at x = 0. 
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determinants 


lil-1 INTRODUCTION 


We shall present here a brief introduction to determinants, with sufficient attention 
given to their properties to permit the usual applications. A summary of important 
properties, together with examples, is presented in Section III-4. The reader who 
wishes only a reminder concerning methods of evaluating determinants or their 
application to systems of linear equations may turn immediately to that section. 

We wish to define a real-valued function D(a,,...,a,), where a,,...,a, are 
vectors in ®”, such that 


D(aj4,..-,4n) = Q 


if and only if a,,...,a, are linearly dependent. Such a function, when defined, 
will be called an n X n determinant and will be denoted in the more familiar 
form 


Q@11 @12 ... Gin 

Qo1 G22 ... Gan | 

᾿ ‘ = αι]. 
Qn1 ἀρ ~+- ὅπη 


where the columns of the matrix (a;;) are the components οὗ 81, . .-., a, relative 
to the standard basis vectors e),...,€, of &”. 


Definition Ill-1. A real valued function D(a;,...,a,) defined for vectors 
@,,..-,8, in ®” is called an m X n determinant (or a determinant of 
order n) if it satisfies the following three conditions. 


I. Dis linear in each of its n variables; 1.6. for i = 1,...,”, we have 
D(ai,..., aa; + Baj,..., an) 
= aD(aji,...,4i,.---,8n) + BD(ay,...,a5,..-.5, an) 
for any real numbers a, β and any vectors aj, a;,..., a, in R”. 


II. If a; = a; for some i, j, Gi ¥ J), then D(aj,..., 8.) = 0. 


Ill. D(e;,..-, en) = 1. 
680 
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Condition II of the definition is a very special case of the desired connection 
between linear dependence and the vanishing of determinants. This same connec- 
tion would demand, of course, that D(e,,...,¢,) be different from zero. Con- 
dition III may therefore be regarded as normalizing the value of D(a,,..., an). 
We shall see, in fact, that the three conditions of the definition serve to determine 
the function D uniquely (Theorem III-3). 


EXAMPLE. If 2 = 1, we are concerned with a single vector a; = a,e, of @’. 
Then by Conditions I and III, we have 


D(a;) = D(aye1) = a,D(e1) = 43. 


Similarly, if = 2 and the vectors ay = α1161 + 4516. and ag = 4126} + Ao2€e 
are given, then I and II yield 
D(aj, 42) = Daze; + 9162, A121 + (2269) 
a,,D(e1, A12€1 + Ge2@2) + Go1D(e2, ay2€1 + 45262) 
41 3[412D(e1, 61) + a22D(E1, €2)] 
+ 23[412D(e2, 61) + a22D(C2, €2)] 
41 1422D(e1, €2) + 421412D(E2, €1). 


Moreover by Condition IIJ, D(e1,e2:)= 1, and by Theorem [II-2 below, 
D(eo,e;) = —1. Thus 


D(ay, 8.) = 11222 — 2112. 


Since the function D is defined for n-tuples of vectors 


11 Gin 
ay = : 9 ee 8 ΞΞ : 9 
An} ann 
we could just as easily view it as defined on the set of n X n matrices 
Qi, 5 Gin 
M =| : : ). 
Qni 5 ἄρῃ 


In this case we follow the usual custom of denoting its value by det M or by 
|a;;|. Thus 


Qi; @\2  ἄϊῃ Q11 Ain 
421 G22 5 Gan} _ D 2 le | aon 
Qn1 Qn2 5) Ann Qn} an 


The results of the example above then take the more familiar forms 


Q11 a 
[αἰ = ay and | 


= 411422 — 42119. 
ao1 ἥν, 


These formulas will be generalized in the next section. 
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lii—2 BASIC PROPERTIES OF DETERMINANTS 
Let D be a function satisfying Conditions I through III of Definition 1Π--1. 


Theorem Ill-1. Jf one of the vectors a1,...,€@, is the zero vector, then 
D(ay, ligt ee an) = Ὁ. 


Proof. Say a; = 0. Then by Condition I, 


D(aj,...5 Ai. +5 An) = D(aj,...,0°a;,..., an) 
0: D(ay,...,4,...,a,) = 0.8} 


Theorem Ili-2. Jf the sequence of vectors by,...,b, is obtained from 
A1,..., an by interchanging a; and a; (i « 7), then 


D(b,,...,b,) = —D(ay,..., ap). 


Proof. Replacing both a; and a; in D(aj,...,4@;,...,4),..., 4p) by a; + 8). 
and applying Conditions I and II, we have 


0 = D(ay,..., a + aj,..., 4: + 8,..., 85) 
=) D8is 225864 ASA) 
+ Daj, ..+, Aj. ++ 5 Aj --- 5 An) 
ΞΕ D8 ios 6g απ τς Bes se arg An) 
+ D(aj,...,8@j,...58j,..+ 5 An). 


But the first and fourth terms of this sum vanish (by Condition I) and the sum of 
the second and third terms is therefore zero as desired. J 


By applying Theorem III-—2 repeatedly to adjacent vectors in the list aj,..., an, 
we obtain the following corollary. 


Corollary. Jf the sequence of vectors b,,...,b, is obtained from a1, ..., An 
by shifting one of the a; k places to the left or right, then 


D(bi,..-,bn) = (—1)*D(ai,--- , an). 


Now suppose that we take some permutation e),1), €p2),---»€pin) Of the 
standard basis vectors of ®”.* Then, by successively interchanging pairs of vectors 
in this list, we can rearrange the vectors into the “natural’’ order e;,..., en, 
and thus by Theorem III-—2 we have 


DCp ys --+sepny) = +D(C1,..-5€n) = £1, (III-1) 


* A permutation of the set {1,...,} is just a one-to-one function p mapping this 
set onto itself. 
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the plus or minus sign being chosen according as the number of interchanges 
required for this rearrangement is even or odd. It is of course an essential fact 
(which we shall not prove here) that the number of interchanges is either always 
even or always odd for all possible ways of carrying out the above rearrangement. 
The permutation p itself is accordingly said to be an even permutation or an 
odd permutation depending on which of these two possibilities holds.* Let us put 


joe ie ] if Ρ is an even permutation, 
— 1 if pis an odd permutation. 
Then (IIJ-1) becomes 
D(Cp(1)5 +++ Cpny) = O(p). ([Π-2) 
We are now in a position to “compute” the value of D(a,;,...,a,) for any n 


vectors of ®”. For if 


nm 
Ay = GO) “ Aqi@g + ++ + Ani€n = De Aj1e;, 
j=1 


n 
an = Aine, + Aon€2 + os + QAnnen = > Ajn€;, 
7ΞΞῚ 


then repeated application of property I yields 


nr n 7 
αι τον αλλ (Σ 6. Gees aint) 


n γι nN 
= ) a;,,D (ci, ) Ajo@j,..-, > ain) 
n 7 nL 
ΞΞΞ > Ω͂; 1 > ΟΣ Cre, i 3.5 ) ane) 
ji=l1 jo=1 j=l 
nr n nr 
= ) Qzy1 ) A752 yeas > a; nD(e;j,, Cjos ine ἐς ἢ 6;,) 
71-ΞΞ1 jo=1 7πΞΞ1 
n n n 
= ) ) vee > Gj 1G),3°** Aj yD Cj G08 3s OR) 
J1=1 jo=1 In=l1 


In this last sum, however, the only terms which are different from zero are those 
for which the sequence /j;,..., jn 15 a permutation of the numbers 1,..., 7; for 
only in these terms are there no repetitions among e; ,...,e;. We may rewrite 


* A well-known method of determining whether p is even or odd is to count the number 
I of inversions in the list p(1), p(2), ..., p(n), i.e., the number of pairs p(i), p(j) of these 
integers for which i < j and p(i) > p(j). The permutation p is even or odd according 
as I is even or odd. For example the list 3, 1, 2, 5, 4 contains three inversions, hence an 
odd number of interchanges is required to rearrange this list into the natural order. 
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this sum, therefore, in the form (using III-2) 


D(ai,---5n) = >) σ(ρ)αρᾳγιάρ(ῶγ5 * * * Apcnyns (1-.3) 


Pp 


where the notation indicates that the sum is extended over the n! permutations of 
Ale eee 

The derivation of Eq. (IIJ-3) from Properties I through III of Definition 111--| 
demonstrates that if there is a function D which satisfies these properties, then its 
values must be given by Eq. (III-3). Thus there is at most one function (for each n) 
satisfying the conditions of Definition IIJ-1. Moreover, it is not difficult to show 
that the function defined by Eq. (III-3) does in fact satisfy I through III. We shall 
omit these details and merely summarize the results in the following theorem. 


Theorem IlIl-3. For each n, there is one and only one function D satisfying 
Properties 1 through ΠῚ of Definition 11--Ἰ. Its values are given by the formula 


Dar, .-- 5 An) = Σ᾽) o(p)apiay14pc2)2 °° * Apinyn: (11-4) 


Pp 


If we compare formula (111--4) with the matrix 


Qi, @j2 *** Gin 
a a eoee qd 

M = 21 22 2n : 
αι Qn2 ‘°° ἄγῃ 


we note that the right-hand side of (III-4) consists of the sum of μ' terms, each 
one a product of n factors chosen from among the entries of M in such a way 
that no two of these factors occur in the same row or the same column of M. 


EXAMPLE. We can also use (IIIJ-4) to obtain the result of the example in the 
preceding section. For the value of the 2 Χ 2 determinant is given by (III-4) as 


D(ay, a2) 


I 


Vee el 
491 422 
O(P1)11d22 + O(p2)d21412 = 411A22 — 421412, 


the signs of ¢(p;) and o(p2) being determined by counting in their respective terms 
the number of inversions in the arrangement of (first) subscripts. 


The 3 X 3 determinant D(a, a2, a3) may also be evaluated by direct applica- 
tion of Eq. (III-4), and in this case we obtain 


Qii G@12Q 413 
Qo, G22 423 
431 432 433 
11422433 + 21032013 + 431412023 

— 4310429413 — 421412433 — 4114329493. 


D(a, 82. a3) = 


ll 
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For practical purposes, Eq. (III-4) is of little use for determinants of order 
greater than three. Indeed the expansion of a 4 X 4 determinant would have 
24 terms, that of a 10 X 10 determinant would have 10! = 3,628,800 terms, 
and so forth. The remainder of this section and the next are devoted, therefore, 
to properties of determinants which lead to simpler procedures for computing 
their values. 

From this point on we shall use in most cases the matrix notation 


Qi, αι 5 Gin 
Qg1 252. *** Gan 
aij] = : 
Qn1 Qn2 °°* Ann 
for the n Χ n determinant D(a,,...,a,). In conjunction with this notation we 
shall refer to the vectors 
a1; 
a9; 
a; ae . ae I, 2; » ἢ, 
Qn j 


as the columns of the determinant and to the vectors 
(Q;1, Aj2,.. +5 Ain), [= i eres ἢ: 


as its rows. Multiplying a column (row) by a real number a or adding two columns 
(rows) is to be interpreted, therefore, as performing these operations on the cor- 
responding vectors. We shall allow ourselves the usual misuse of language which 
confuses a function with its values, and in this case we shall often speak of the 
determinant |a;;| when we are really speaking about the matrix (a,;) or about 
the value of the function D on this matrix. Context will always provide the exact 
meaning. 


Theorem Ill-4. Let M = (a;;) be ann X n matrix and let M’ = (6,;) be 
the transpose of M, 1.6. the matrix whose columns are the rows of M (thus 
b;; = a;;). Then 

det M = det M’. 


Proof. From (Π1--4) we have 


det M = > O(P)Ap(1)1%p(2)2 τ Apnyn 
Dp 
and 


det M’ = >» O(P)bp1)1Opay2* + * θραι)η 


p 


> O(P)A1p(1)42p(2) " "᾿ Angin): 
P 


Thus the n! products which enter into the expansion of det M are precisely those 
which occur in the expansion of det M’, and we need only show that they occur 
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with the same algebraic signs. For this purpose let 
Qp(1)14p(2)2 °° * Ap(nyn and 4 1q(1)42q(2) "ἡ Gng(n) 


be two corresponding products, i.e. products which differ only in the order of their 
factors. If we apply the permutation p to the second product (or more exactly to 
the subscripts of its factors) we obtain 


Qn(1)p(q(1))4p( 2)p(q(2)) °° * &p(n)p(qin)): 


But by definition of the transpose this must agree with the first product, and hence 
p(g(@i)) = ifor i = 1,2,...,n. This implies that either p and ᾳ are both even 
permutations or else both are odd. Thus a(p) = o(qg). and we are done. ἢ 


The last theorem may be stated informally by saying that the value of a deter- 
minant is unchanged if its rows and columns are interchanged. This result permits 
us to concentrate on just the columns of a determinant. Each theorem that we 
prove will remain true if the word “column” is replaced by “‘row”’ and vice versa. 

Certain useful properties of determinants are immediate consequences of Defi- 
nition III-1. For example, it follows from Property I that the value of a determin- 
ant is multiplied by the real number k if each of the entries in a single column or 
row are multiplied by k. We also easily obtain the following useful result. 


Theorem Ill-5. The value of a determinant is not changed by adding a 
multiple of the jth column (row) to the ith column (row) if i ¥ ). 


Proof. This is an immediate consequence of Properties I and II, for 


D(ay,...,@ + ka;,...,8@j,...5 an) 
= ),Ὰ(8ι,..., Bi ey By os oy a) HRD Gy 6x5 87»... ἃ)» sag An); 


and the second term of the last expression vanishes. J 


_ Theorem Ill-6. Jf the vectors a,,..., a, are linearly dependent, then 


αι *°* Gin 


Dax. τὸς 8g) = ᾿Σ : 
(a;, 3 n) Gy τ" Ann 


Proof. Suppose a; = > 0%, c;a;, with c; = 0. Then using Property I, we have 


n 
D(ai,..., Ai. --5 An) Dg τοῖς Dy CA se) 
j=l 


n 
2 CFD ay jee ΦΑΣΙ sg Ay): 
j=l | 
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But in this sum, the ith term vanishes because c; = 0, and each of the other terms 
also vanishes because in each case two of the vectors to which D is applied are 
equal. ἢ 


The last theorem provides half of the desired relationship between determinants 
and linear dependence. The converse is obtained in the next section where we 
introduce one further topic essential for applications. 


lll-3 MINORS AND COFACTORS 


Let us begin this section by evaluating D(e,, ao,...,4,), where a2,...,4, are 
any n — 1 vectors of ®”. Applying Theorem IJI-3, we write the value of this 
determinant in the form 


Ι ayo *** Ain 

Ια, = |9 aoe -°° don = >, F(P)Ap.1)14 1292 ‘++ @pnyn. (1Π--5) 
. ᾿ » 
0 Ang φῶ Ann 


But the only terms in this sum which are different from zero are those for which 
the permutation p satisfies p(1) = 1. Moreover, for every such permutation, the 
number of inversions in the sequence p(1), p(2), .. . , p(n) is the same as the number 
of inversions in the shorter sequence p(2), p(3),..., p(n). The value of (III-5), 
therefore, reduces to : 


>> O(q)4q(2)24q(3)3 * * * Ag¢n)ns 
4 


where 4 ranges over all permutations of {2, 3,...,n}. That is, 
Ι aye Ain dns, 8 Vase 
Ὁ 422 Fan) = |: (111-6) 
. Qn2 5 Ann 
QO Gno ἄρῃ 
Now suppose we wish to evaluate the determinant 
αι 5: ἄς 0 ayyjgy τ᾿ Ain 
Ρίαι,..., ae eee ΠῪΞ ain Ps Gey 11: vasa 23 Fin 
Gn) -* Ansj-1 0 νοι. 0: Onn 
(Π1-7} 


By applying the corollary to Theorem [1{-2, we may move the jth column j — 1 
places to the left thus multiplying the value of the determinant by (—1)’—'. Then 
applying this corollary once again (in conjunction with Theorem III-4), we move 
the ith row up i — 1 places, this time multiplying the value of the determinant by 
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(—1)'—!. The resulting determinant now has the form (III-5) and hence can be 
reduced to an (n — 1) X (n — 1) determinant by applying Eq. (III-6). The 
value of D = D(aj,..., 8;.--.1, Ci, Aj4.1,---,» An) 15 thus given by 


D = (-1'" Mi;, (111-8) 


where M;; is the determinant obtained from (III-7) by deleting the ith row and 
the jth column. We give formal status to this new (n — 1) X (ἡ — 1) determinant 
in the following definition. 


Definition IlI-2. Let D be any n X n determinant. For each i, j (1 < i, 
j <n) let M;; be the (7 — 1) X (@ — 1) determinant obtained from ἢ 
by deleting the ith row and the jth column, and put 4;; = (—1)'T’M,;;. 
Then A,; 15 called the cofactor of the entry a;;, and M,; the minor determinant 
of this entry. 


We are now in a position to prove the main theorem of this section. 


Theorem Ill-7. For any n X n determinant D = |a;;|, we have 


DS) αμρά., J = 1,2,...,π, 0 (111-9) 
i=l 
and 
Ρ- δ)αιμάῃ», t= 12st (Π1-10) 
j=l 


Proof. Let j be fixed and write a; in the form 
n 
aj = > α:)6;. 
t=1 


Applying Property I of Definition III-1 followed by Eq. (III-8), we have 
D: = DG sie5 Bases Aa) 


nr 
δ) a;;D(ay,..-5@i---5 An) 
i= 


nr 
= ». A;;A 43. 
t=] 


This proves (III-9), and (III-10) now follows from Theorem {Π--4, for if B,; is 
the cofactor of b;; in the transpose, then >>; 6;;B;; = D0; ajiAji = Σὺ) GijAi;- ἢ 


Equation (III-9) is often referred to as the expansion of Ὁ by cofactors of the 
(entries of the) jth column. Similarly (IH-—10) gives the expansion of D by cofactors 
of the ith row. Either of these formulas permits us to reduce ann X n determinant 
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to a sum of n determinants, each of order n — 1. They provide, therefore, a very 
efficient method for evaluating arbitrary determinants, especially when used in 
conjunction with Theorem III-5. Before turning to examples, we obtain one 
important corollary of the last theorem, and apply these results to obtain the 
converse of Theorem III-6. 


Corollary. For any n X ἢ determinant D = |a;;|, we have 
> ἀράς = 0, fk =1,....0, JAK, 411-11) 
ἐξὶ 

and 
>. aij4u3 = 0, LK=1,...,0, ἱ γέ Κ. (Π1-12) 


Proof. Every term of (III-11) is unaltered if the kth column of D is changed. 
Hence we may set a;, = αι). ἱ = 1,2,...,4. Then 


Tr nr 
> —AijAn = > aA ik. 
=A ae 


But the latter sum vanishes since it is the expansion by cofactors of the kth column 
of a determinant whose jth and Ath columns are equal. Similar reasoning applies 
to (IlI-12), using (1Π--10) in place of (III-9). f 


Theorem Ul-8. 4 necessary and sufficient condition that a set of n vectors 
41,... ,@» in ®” be linearly dependent is that D(aj,...,@n) = 0. Thus 
ann X n matrix A is nonsingular if and only if det (A) 4 0.* 


Proof. The necessity of the condition has already been established in Theorem 
IlI-6. To prove the sufficiency we must show, conversely, that if det (A) = 0, 
then the columns a,,..., a, of A are linearly dependent. 

Consider first the case in which the cofactor Apq of some entry ap, of A is differ- 
ent from zero. Then (III-10) and (III-12) yield 


>> aij4pi = 0, 7G = 1,2,...,0, (111-13) 
j=1 


and we conclude that 


>> 4,8; = 0. 
j=l 


* A matrix A is called nonsingular if it has an inverse, i.e., if there is a matrix B such 


that AB = BA = I. Theexistence of such an inverse, usually denoted 4~!, is equivalent 
to the linear independence of the columns of A. 
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Since at least one of the coefficients (viz. A,,) in this linear combination is not 
zero, the vectors a;,..., a, are linearly dependent, and we are done. 

If the cofactor of every element of A is zero, then (except in the case in which 
a; = 0 for all ), where the theorem is obviously true) there exists an integer r, 
1 <r<n — 2, such that for some r X r submatrix M we have det (M) ¥ 0 
but for every larger submatrix M’ we have det (ΜΠ) = 0.* Since the order of 
rows and columns is immaterial, we may assume that Μ, lies in the first r rows 


and columns of A, 1.6. that 
αι 5 Qtr 
M=\: ae i 
αὶ τ Arr 


Now choose k so that r + 1 < k < nand let M’ be the submatrix 


Qir 7 ἄτι, Ajsr41 
M = 1[4rn τ Grr α,,γ- ΕἸ 
Qky *** Akr Aksr4i1 


We note that for 7 = 1,2,...,7 + 1, the cofactor of a,; in M’ is independent of 
k. Denote it by A;. Then (III-10) and (I-12) once again yield 


a;jA; = 0, i= l, seeg ἢ, OF Pak (III-14) 


Since k was chosen arbitrarily from {r + 1,...,a}, the relation (III-14) holds 
fori = 1,2,...,n, and hence is equivalent to 


r+1 


>> Aja; = 0. 


j=1 
Since 
Ary = det (M) x 0, 


we thus conclude, that a,,...,4,,, are linearly dependent and hence that the 
same is true Of a;,...,an. ἢ 


lii-4 SUMMARY AND EXAMPLES 


To each n X n matrix (a;;) we associate a real number called the determinant of 
the matrix (or determinant of order n) and denoted by 


Qi1 G2 5 Ain 
Qn1 Gn2 °*** Ann 


* By anr Χ s submatrix of a given m X n matrix A, we mean a matrix obtained from 
A by deleting m-r rows and n—s columns. 


|-4 SUMMARY AND EXAMPLES 691 


The value of this determinant is given by 


lays] = Σ᾽ o(P)apcryr4pc2)2* + * Apcnyns (III-16) 


p 


where p ranges over all permutations of {1, ... , 2} anda(p) is +1 or —1 according 
as the number of inversions in the sequence p(1), p(2),...,p(m) is even or odd 
(see footnote on page 683). 

Except for determinants of small order, however, Formula (III-16) is of little 
practical use. In fact even a 4 X 4 determinant would already have 4! = 24 
terms in its expansion, and the evaluation of a 100 X 100 determinant by means 
of this formula would be completely out of the question.* 

Fortunately, quite efficient techniques exist for computing the value of [α;]. 
They are based on properties of determinants developed in the preceding sections 
which we review here and illustrate through examples. In so doing, we recall that 
when we speak of the columns (rows) of the determinant (III-15) we are really 
referring to the column (row) vectors of the matrix (a;;). This terminology is 
customary, though nonsensical, and fortunately leads to no great confusion in 
practice. Operations performed on columns or rows (for example multiplying a 
column (row) by a constant or adding one column (row) to another) are under- 
stood as operations on vectors. For more formal statements of the following 
properties, the reader may refer to Sections IIJ-1 through III-3. 


Summary of properties of determinants 


(1) If a single column (row) of |a;;| is multiplied by the constant k, the value 
of the determinant is multiplied by k. 

(2) If two columns (rows) of |a;,;| are interchanged, the value of the determinant 
is multiplied by —1. 

(3) The value of the determinant |a;;| is unchanged if a multiple of one column 
(row) is added to another column (row). 

(4) The determinant |a,;| vanishes if and only if its columns (rows) are linearly 
dependent. In particular it vanishes if two columns (rows) are equal or if one is a 
multiple of another. | 

(5) The value of the determinant [α;; is unchanged if its rows and columns are 
interchanged. 

(6) If each entry in a fixed column of |a;,| is multiplied by its cofactort and the 
results are added, the sum is the value of the determinant; i.e., for any fixed /, 
l<jcn, 


n 
|a;;| — > A;;A jj. (111-17) 
i=1 
* It has been estimated that the fastest modern electronic computer would require sev- 


eral centuries to compute and add the 100! terms of (III-16). 
Tt See Definition III—2 for the meaning of the term cofactor. 
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The corresponding statement for rows is also true. Namely for any fixed i, 
l<i<a, 


las] = Dy assay. (III-18) 
j=1 


Equation (III-17) is called the expansion of |a;;| by cofactors of the jth column 
and (IIJ-18) the expansion of |a;;| by cofactors of the ith row. One consequence of 
(4) and (6) is the following property: 

(7) If each entry of a fixed column (row) of |a;;| is multiplied by the cofactor 
of the corresponding entry of a second column (row), and the results are added, 
the sum is zero. More precisely, 


> ajAn =0, fk =1,...,n, f#k, 
i=1 


(111-19) 
>) ἀπά) = 0, ik =1,...,n, ik. 
j=1 


EXAMPLE 1. For determinants of order <3, it is not difficult to apply (III-16) 
directly. For the first-order determinant |a| we obtain, of course, [α] = a, and 
for determinants of orders 2 and 3 we obtain, respectively, 


lacs a19 


= @114292 — 4@214)2, 
(91 pa 


Qii1 GQ 413 
Qo1 422 493 
431 432 433 


= 11022033 + 431@12A23 + 21432013 
— 310822013 — 4210812433 — 411432093. 


The last of these formulas is frequently remembered by forming the six products 
indicated by the arrows in Fig. IIJ-1 and assigning a plus or minus sign according 


FIGURE Ill 
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as the arrow points downward or upward. Thus, 


i ἢ 
0 1 ol ee a1) Ξ 8) Ὁ 3-02 
BB AN aecGudlieGyee (= 6)e9 9s Σ᾿ 
= 14 00 012 $24, — 0 = 50; 
while 
a. 
3 |= 3-1 —(-1)-4 = 3 + 28 = 31 


EXAMPLE 2. The rule for expansion by cofactors may be used to evaluate the 
third-order determinant of Example 1. Expanding by cofactors of the Ist row, 
for example, we have 


2 =i. ἢ 
1 —6 0 —6 0 1 
Be oe ἢ 4 7 4 2 


27 + 12) ++ (0 4+ 24) + 30 — 4) 
2-19 + 24 — 3-4 = 50. 


Expanding instead by cofactors of the first column, we have 


2 --ἰ 3 
ie bee eee ὃ 
4 2 7 


= 2(7 + 12) + 4(6 — 3) = 50. 


EXAMPLE 3. The expansion of a determinant by cofactors is particularly simple 
if most of the entries in some column or row are zero, and this suggests that we 
first apply Property (3) above to bring about this situation. As an illustration we 
evaluate the fourth-order determinant 


3 #7 9 1 
1. 5 . 57 ep 
ῬῊΞ δ᾽ ὦ, ἃ. δ᾽ 


ὃ 0 2 -- 


Multiplying the third column by —4 and adding it to the first column introduces 
a second zero into the fourth row. We then add twice the third column to the 
fourth column, introducing a —1 into the lower right corner. Thus 


— 33 7 9 29 — 33 7 67 29 

D= 39 5: ed 1G): _ || ~ 32 5 ~—39 ~—16 
—10 2 4 17 —10 Zz 38 17 
0 0 2 --ἰ 0 0 0 “--1 
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the second determinant being obtained from the first by adding twice the fourth 
column to the third column. If we now expand by cofactors the fourth row, we 
obtain 


—33 7 67 —33 7 67 
D = (—1)***(-1)|_ 33. 5 -39- —| 39 5 —39]> 
—10 2 38 —10 2 38 


and the computation could be completed as in Example 1. We continue, however, 
by factoring a 2 from the third row with the aid of Property (1) and then adding 
multiples of this row to each of the first two rows. That is, 


—33 7 67 
D=-—2| 39 5 —39 
a5 οἷ 19 
2 0 —66 
= —2} 39 5 —39 
=5 1 19 
2 0 —66 

a9] 64. 0 134): 
a5 εἱ 19 


We now expand by cofactors of the second column, obtaining 


D= (2-1) | ie — 2(—268 + 4224) = 2- 3956 = 7912. 


As a final example, we illustrate the application of determinants to systems of 
linear equations. 


EXAMPLE 4. Consider the system of equations 


Q141X1 + QyoXq ἘΠ 5 + AinXn = δι, 
ἄφιχι + Ag2Xq + Τ᾽ + AanXn = do, (III-20) 
Qn1X1 + QAn2X2 + aan + annXn = bn, 
and let 
Qii4 G12 ***° Gin | 
D=\|: : (Π1-21) 
Qni Qn2 5 ἄρῃ 


be the determinant of coefficients of this system. If we multiply the first of these 
equations by Aj, , the second by 49, etc., and then add, we obtain 


ὩΣ aidan Ja ἢ (Σ ainda Xs te ἘΣ) ainAss γεν = > διάμ. 
i=l i=1 i=1 


t=1 
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But the coefficient of x, is then just the value D of |a;;| itself, and the coefficients 
of Xg,..., Xn are (by Eq. III-19) all zero. Thus we have 


Dx, = > b;Ai, 
i=1 


and if D + ὁ we have determined x,. Of course, instead of 41: we could have 
used the cofactors of the jth column of (III-21). We would then have obtained 
the formulas 


Dx; = >) bi Ais, J = | ee merry 
i=1 
for the x;. 

If D ¥ 0, it is easily verified that these x; do satisfy (III-20). Moreover, the 
solution of (III-20) is unique if and only if the columns of (III-21) are linearly 
independent (see Theorem 2-12 in the text). But, by Property (4), this 15 equiv- : 
alent to the nonvanishing of D. Thus we have the following theorem. 


Theorem Ill-9. The system (111--20) of n linear equations in n unknowns has 
a unique solution if and only if the determinant of its coefficients is not zero. 
In this case, moreover, the solution is given by 


δ᾽ διΆ;; 
ὡς fel : 


Χ; = mS Say J = | rere (11-22) 
It is worth noting that the expression in the numerator of (III-22) is just the 
expansion (by cofactors of the jth column) of the determinant obtained from the 
coefficient determinant |a;;| by replacing the jth column by the vector (b;,..., bn); 
that is, 


Ga: HO he, SRS ae 
lan τ": bn ttt Ann ἫΝ 
a ee ΤΕ ΣΑΣ τὰ 7) Ξ 1,2,..., ἡ. (111-23) 
anil eee Qn j 2 ee ann 


When written in this form, (III-23) is called Cramer’s rule for solving the given 
system of equations. 


EXAMPLE 5. The system 


| 
—" 
> 


3x —5sy = 
x+ 2y = 


| 
ω 


has coefficient determinant 
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and hence has the solution 


i ig | 
3 2 28-|15 4 
See ΜΓ oe 5 
3 ᾿ 1 il 
1 2 
: i 
_ tl 3} 9-14 -5 
oe “5 iC 
1 2 


It is clear, of course, that the method of Examples 4 and 5 can be applied only 
to systems of equations for which the coefficient matrix 1s a square matrix, and 
for this reason solutions given by (III-—23) are largely of theoretical interest. 


Ii-5 MULTIPLICATION OF DETERMINANTS 


Consider the 2n * 2n determinant 


αι ὃ Gun O «+: 0 
eee ee, Bre ee re (111-24) 

Cuz 5 Cin By, +++ Din 

Chi 5 Cnn Dnt ὝΦΟΣ Dan 


According to (III—16), its value is given by 


leis] = >) o(P)epcyrepiare ** * epcenyens (III-25) 
Pp 


where p ranges over the (2n)! permutations of {1,2,...,2n}. Since e;; = Ὁ for 
1<i<a,n+1 <j < 2n, the only terms of (IIJ-25) which are different from 


zero are those for which p satisfies the inequalities 
1<p@<n for l<i<a, 
n+1< pli) < 2n for n+1<i7< 2η. (111-26) 


Moreover, for such a permutation p, the number of inversions in the sequence 
pC), p(2),..., p(2n) is the sum of the number of inversions in the sequences 


pC), p(2),...,p@™ 


p(n + 1), p(n + 2),..., p(2n). 


and 


ea 
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Each term of (III-25), therefore, can be written as a product: 
O(r)o(S)Qr¢ 4) 1472) 2 ἜΝ Arnynds(1)108(2)2 p=: Dacayns 


where r and s are permutations of {1,...,} and o(r)o(s) = o(p). Thus 


leaj| = δ O(P)€piiyi* ** epcanyan 


Pp 
= De Σ, a(r)o(S)ar1)1 °° * ArnynBscayi "ΠῚ Bscnyn 
Tr 8 


aes δ σ(γ)αγαγι ** * Arcnyn * > 0(S)be(1)1 °° * Oscnyn 


r $ 


= |a;;| [δ]: 


and we have proved the following lemma. 


Lemma. Regardless of the values of the c;;, the determinant (III-24) is the 
product of the two “sub-determinants” |a,;| and [δι]. 


Let us now choose c;; = Oifi γέ jandc,;; = --ἰ. Then we have 
αι °°: Gy O - 0 
αι "ας O -- 0 
ii)  |δ1}} = ; ΠΙ|-27 
Ια i |b 5 ἐξ: $22. ς 0 δὴ ΠΝ bin ( ) 
-1 : 
ὃ 266 7b: eee by 


Denoting the first 2 columns of (III-27) by Ci,..., Cn, and adding the sum 


Σ, δ; = By, + δι τ + Onin 


i=] 
to the (n + 1)st column, (III-27) takes the form 
Q414°°* Gin Laryibi 0 .-- 0 
Qn1°** Ann Danidit Qian 
ail - (Dal = : 
Ια: + [bis] 2 ces 10) 0 bio° ++ Din 
— Ἰ 3 : 


ee | 0 δ σις 
Similarly, adding Σὰ b;2C; to the (a + 2)nd column, d= by3C; to the 


 —— 
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(n + 3)rd column, etc., we obtain finally the determinant 


Qi, 7 Qin Vayibay +++ Vayibin 
| | b | a ἄνα; Onn Vandi tee Lan Din (111-28) 
Ajj) * 1012} = ᾿ i 
: ' oh aces “πῇ 0 ste 0 
Oo “eu τ 0 aoe 0 


which, by repeated application of Property II of Section III-4, can be written 


LY ge. οἷἢ 0 ae 0 
0 ‘—] 0 oe 0 
la;;| ; [;;| = (—1)" fay, τ: Qin Veaiibiy “τ: Varin]. 


Qni °*** Ann Dan idit oo Dan din 
We now apply the lemma once again, obtaining 
—Loss+ Of |Xaibi ὅν  Laribin 


la) - |baj| = (—1)" | : - 
=I > an ibit oo >and in 


Finally noting that 


af. wae. 36 
(—1)" f= Dt = et? = 1, 
| 
we obtain 
> azide > a1 idDin 
laz;| - ἰδ} = te (111-29) 
> an ibit ἘΝ ἃ Σ ἀρμέϑιι 


Thus if we are given matrices 


Qi, °*** Gin bit τ: Din 
A=\: Ε} Bal: :} 
Qn1 5 ἄρῃ bry τς Dan 


the determinant on the right of (III-29) is seen to be the determinant of the matrix 
product of A and B, and we have 


Theorem Ilil—-10. Jf A and B aren X n matrices, then 


det (AB) = det (A) - det (B). 
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It follows from’ Theorem If-10 in particular, that if A is a nonsingular n X ἢ 
matrix and A~? is its inverse, then 


Ι 


det (4 ἢ ~ det (A) : 


For det (4 ἢ) - det (A) = det(A7'A) = det (1) = 1. 

We conclude our discussion of determinants with one further application of 
Theorem IJJ-10. Namely, let A = (a;;) be any m X n matrix, and consider its 
characteristic polynomial* 


aj, — λ Ay2 ce Ain 
a doo — A °°? a 
det (A — AI) = δὰ τ se 
Qn1 Qan2 “τ Ann — λ 


Then for any nonsingular matrix P, we have 
det (PAP! — XI) = det (PAP! — APIP™") 
= det (P(A — \J)P~?) 
det (P)- det (A — dJ)- det (P—") 
= det (A — DJ). 


This proves the following theorem. 


Theorem Hl-11. Jf A and B are similar matrices, i.e., if there exists a non- 
singular matrix P such that B = PAP~', then A and B have the same char- 
acteristic polynomial. 


It is not difficult to show that two n X n matrices are similar if and only if they 
represent the same linear transformation L: ®” — @” (relative to possibly dif- 
ferent bases). Since Theorem ΠΙ-11 asserts that the characteristic polynomial of 
two such matrices is the same, it follows that the characteristic polynomial which 
is associated with L by choosing a matrix representation for L is independent of 
the particular matrix used. This allows us to conclude that the eigenvalues for L 
can be found by representing Z in matrix form and solving the resulting charac- 
teristic equation for λ. ἢ 


* See Section 12-3. 
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uniqueness theorems 


IV-1 SURFACES IN @?, SURFACE AREA 


Our objective in this appendix is to prove the uniqueness of the solutions obtained 
in Chapters 13 through 15 for various boundary-value problems involving partial 
differential equations from mathematical physics. For this purpose it will be 
necessary to introduce several concepts from vector field theory, among them the 
notion of surface integral. However these ideas will be developed only to the 
extent required for the stated goal. 

A surface 8 in ®? is said to be represented parametrically if it is the range of a 
function τ; R2 — 6.3. In this case 8 is the set of points (x, y, z) in R® satisfying 


x = x(u, Ὁ), 


y = yu, v), (IV-1) 
z = 2(u, v), 


where x(u, v), y(u, 0), Ζίω, v) are the coordinate functions of r and (u, 0) lies in a 
region Κων of 612. Equations (IV-1) are called parametric equations for 8. For 
example the sphere of radius Καὶ in ®® centered at the origin is represented para- 
metrically by 


x = Reosusinv, 
y = Rsinusinv, 
z= Rcosv, 


where (u, v) lies in Ryy: Ὁ <u < 27, O < v < or (See Fig. IV-1). 
A surface 8 may also be represented explicitly in the form 


ΖΞ I; y), (x, y) in Rey (IV-2) 
or implicitly as the set of points satisfying an equation 
F(x, y, 2) = 0. (IV-3) 


We are familiar with each of these forms in the case of the sphere described above. 
For example, the equation 
x24 yp? 4 22 = R? 
700 
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(0, 1, 0) 


FIGURE IV-1 


defines this sphere implicitly, while the upper and lower hemispheres are explicitly 
represented by the respective equations 


z= VR? — x2 — y2, x2 + y? « R, 


and 


z= —VR2 — x2 — y2, x2 + y2 < R?. 


It is usually the particular application at hand that determines which of the above 
representations is used. 

We shall say that a given surface 8 is smooth if it has a unique tangent plane at 
each of its points P and if this tangent plane varies continuously as P ranges over 
the surface. In this case we can erect at each point P of 8 a vector N which is normal 
to 8 at P (i.e., perpendicular to the tangent plane at P). For the explicit represen- 
tation (IV—2) of 8, the property of smoothness amounts simply to the continuity 
of the partial derivatives af/dx and 9f/dy, and a normal vector N is then given by 


je Oi 2 
N= gyi t & (ν-4) 


where i, j, k are the standard basis vectors of ®°. For implicit and explicit repre- 
sentations, however, we must impose assumptions in addition to continuity of the 
partial derivatives involved. Thus (1V-3) yields a normal vector | 

OF. , oF. , OF | | 
provided that this vector does not vanish, while in the case of the parametric repre- 
sentation (1V—1), the vectors 


or Ox. Oy. OZ 

aa ut Τὰ 

: (IV-6) 
r ox, Oy . OZ 

dv pr ap it ap & 
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are tangent to the surface 8 and hence determine the tangent plane only if they are 
linearly independent. In the latter case a normal N to ὃ at the point P = r(u, v) 
is orthogonal to each of the vectors (IV-6) and hence may be expressed in the 
form 


ij Κα 
ν- ὅτ yy OF _ [ax ay ὃ2 
~ Ou ~~ dv du ou du 
ax ay az 
ov ov av 
ὃν az| az ax| ὃχ ὃν 
Ou OU Ou OU Ou OU 
~ Jay az]! 82 δχ * Jax ὃν" oe 
Ov OD Ov Ov Ov Ov 


[all partial derivatives evaluated at the point (wu, v)].* 


EXAMPLE 1. For the sphere 8 defined parametrically by 
x = Reosusinv, y= Rsinusinv, z= Rcecosv, 


Eq. (IV-7) yields 


i j k 
N =1|— Rsinusinvu Rcosusinv 0 
Rceosucosv Rsinucosv — Rsinv 


= — R* cosusin?vi — ΚΖ sin usin? vj — ΚΖ sinv cosvk 
= — R*sinv (cosusinui + sinu sinvj + cosuk). 
Here N is easily seen to be the inward pointing normal at P and ||N|| = R? sin v. 
Employing, instead, the explicit or implicit representations of this sphere, Eqs. 
* For two vectorsa; = xii + γι] + z1k, 82 = xei + yoj + zek in ®3, the vector 
product a, X a2 is defined by 
ay X ag = ("122 — 21y2)i + (z1x2 — X122)) + 1y2 — γιχ:)κ 
i j =k 
ΧΙ Yi Ζιη’ 
X2 y2 Ζ2 


I 


It is easily verified that ay X ag is orthogonal to both 41 and ag and that [41 Χ al 
‘is twice the area of the triangle determined by a; and ag. These properties, together 
with the fact that the vectors a1, 89,81 Χ a2 (in that order) forma right-handed triple, 
serve to determine a; X ag uniquely. 
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FIGURE IV=2 


(IV—4) and (IV-5) yield N in the respective forms 


2x : 2y 


N = ——_—— 14+ —_— 
(ΕΖ — x2 — y? ν ΕΣ — x2 — y? 


jt+k 


or 
N = 2xi + 2yj + 22k. 


We now consider the notion of surface area. Here we begin with a smooth 
surface 8 and a parametric representation r = x(u,v)i + y(u,v)j + Ζίμ, v)kK as 
described above. To obtain an approximation to the area of 8 we subdivide the 
surface into a finite number of pieces AS; by means of a network of intersecting 
curves corresponding to a grid of horizontal and vertical lines in the domain Ry» 
of r (see Fig. IV-2). The approximation is now found by replacing each of the 
AS, by an appropriate portion of the tangent plane to ὃ at a point in AS; and taking 
area on the tangent plane as an approximation to area on the surface. 

Specifically, let w and r(w) be as shown in Fig. [V—2 and let 


or or 
t, = ay (ὟΣ) and fo = 50 OW) 


be the tangent vectors to 8 (Eq. IV-6) at the point r(w). Then if AS; is the image 
under r of the indicated rectangle with sides Au;, Av;, the area of the parallelogram 
formed by the vectors 


as Av; 


or 
t; Au; = — Au,;, {0 Av; = av 


Ou 


will, intuitively at least, provide a reasonable approximation to the area of AS: 
whenever Au; and Av; are small. But, as was pointed out in the footnote on 
page 702, the area of this parallelogram is just the magnitude of the vector 


N Au; Av; = ({; Χ to) Au; Av;, 
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and hence, using (IV-7), we have the required approximation in the form 


ὃν ὃ" | az ὃχ) jax ay|?|*? 


— δἐοό-Ἕ.ὄἝἜὄ- —_—_ 


IN| Rip i Ou OU ἧ: Ou Ou ‘a Ou OU ΔΩ ΑΝ, 


Oy 02z OZ Ox dx dy 
Ov OU Ov OU dv OU 
(IV-8) 


We now repeat the above computation for each of the AS;, add the results, and 
take the limit as the number of pieces AS; is allowed to increase in the usual fashion. 
The value of this limit (which can be shown to exist under the hypotheses in force) 
is, by definition, the area of 8, and we therefore have 


@(s) = | du du 4 du du fe du Ou ΩΝ 
ὃν az} Jaz ax| δὃχ ay 
Ov OU Ov OU Ov OD 


(1V-9) 


This formula is usually written in less cumbersome form as 


ae | (lz zy, ax? 200 Γαι ἣν ΑΥ̓͂. 10) 


δι, 7 a d(u, Vv) d(u, Vv) 
where 
Ox ὃν 
A(x, y) _ |du du) 
d(u, Vv) ax ay 
Ov OD 
etc. More generally the symbol 
O(X1,..-5 Xn) 
δ(μ,, ΡΞ Un) 


is used to denote the n X n functional determinant 


Ou, Ou, Ou, 
0X1 9X2 |, OXn 
ὃ. ὁ θ 19 
ὃχι 9X2 ||, ὅχη 


δ. OUy OUn 
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and is known as the Jacobian determinant of the functions 


x1(u4, δ, aay Un), a aes Xn(U1, ats Un). 


The argument just given can easily be generalized to include integration of 
scalar functions defined on surfaces or, as they are called, scalar fields. In this 
case we begin with a real valued function F defined and continuous in a region of 
6.38, and a smooth two-dimensional surface ὃ in that region. Let § be subdivided 
into a finite number of nonoverlapping pieces AS,;, i = 1,...,m, and choose a 
point P* in each of them. Then the surface integral of F on ὃ, denoted 


[ Ε ds, 


8 
is defined to be 


n 


lim >> F(Pf)a(AS8;), 


where the limit is taken in such a way that the diameter of each of the AS; tends 
to zero.* Here again it can be shown that this limit exists, and that its value is 
independent of the manner in which 8 is subdivided and the P;* chosen in A§;. 
Finally, to obtain a formula for evaluating this integral, let 


= x(u, v), 
yu, v), 


z(u, Ὁ) 


I 


I 


Ζ 


be a parametric representation of 8 defined in a region Κων of the μυ-ρίαηθ. Then, 
following the argument which led to (IV—10), we find that 


ΓΝ 


8 
= | | F(x(u, v), y(u, v), z(u, v)) 2 zy + a(Z, x) τι ae yep du dv, 
Ruy 


O(u, Vv) d(u, v) d(u, v) 
(IV—11) 


where the integral on the right is an ordinary double integral over Ry». Integrals 
of this type are encountered in physical problems dealing with surface distributions 
of matter where they admit interpretations as mass, moments, etc. 


EXAMPLE 2. Use Formula (IV-10) to calculate the surface area of a sphere ὃ of 
radius R. Actually we have already computed the value of 


IN] = 20: zy" ΕΞ a(z, x)” a(x, 2A 


d(u, v) O(u, Vv) d(u, v) 


* By definition, the diameter of AS; is the least upper bound of the set of real numbers 
ΠΡ; — Pol] with Py and P2 in ASs;. 
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in Example 1 where we found that ||N|| = R?sinv. Hence 


a(S) = R? {fsinv du do = Rf [sin w du do = 47R?. 


Uv 


EXAMPLE 3. Find the total mass M of a hemispherical shell 8 of unit radius, given 
that the density of ὃ is proportional to the distance from the base of the hemisphere. 

Let 8 be represented (explicitly) by z = V1 — x? — y?, x? + y? < 1. Then 
parametric equations for ὃ may be given in the form 


x = 4, 

y= vd, 

z=V1 — wv — v2, 
with u? + v? < 1. Since the density of 8 is given by the scalar function p = kz, 
k a (positive) constant, Formula (JV—11) yields 


M = If ds 
8 
ΡΝ Ἰ 0. πῷ dQ, z)” o(z, x) a(x, ἫΝ 
- il ee 5 Ἢ a@,0) * avy} “αν 
μ΄ ευἷἶςκ1 
But 
a(y, 2) u O(z, x) _ υ (x,y) _ 


3 


δί(μ,0) 7 Py as je = (u,v) /1 — uw — v? A(u,v) ” 


whence 


M=k [/ dudv = kr. 
με“ -ευὐς1 


The last example suggests that we simplify Formula (IV-11) (and IV—10) for 
surfaces 8 which are represented explicitly as follows. If 


2 >= IO, y)s (x, y) in Rey 
defines 8, then with 
x= 4, 
Y= 0, 
z= f(u,v), (u,v) in Ru, 
we have 
ay,z)_ 986. δ(, )͵ 6866, OGY) _ 


A(u,v) du OA(uv) ὃν δίῳ) ’ 
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and (IV-11) becomes 
|[ Fas - |f rt ys 76, pli + (2 fy 4 1+ (2) + (2) dx dy. 


IV-2 SURFACE INTEGRALS OF VECTOR FIELDS 


We come now to the problem of assigning a meaning to the integral of a con- 
tinuous vector function, or vector field 


F(x, y, 2) = P(x, y, τὶ + OC, y, DI + RO, Y, DK 


over a smooth surface 8 in R°. To do so we use the integral of scalar functions 
introduced in the preceding section, and tentatively define the required integral to be 


[ (Ε- π) dS, (IV-12) 
ὃ 


where n = n(P) is a unit normal vector at the point P of $ chosen in such a way 
that F-n is a continuous function on 8 (Fig. IV-3). Informally this requirement 
means that we must designate one side of the surface as positive, and let n(P) be 
the unit normal at P which points in that direction. For many surfaces such a 
choice of positive direction is easily made. On the sphere (or any closed surface), 
for example, we may choose n(P) to be the outward pointing normal. And ona 
surface defined explicitly by 


z= f(x,y), (x, y) in Rey, 
we may choose n(P) to be the upward normal 


_ —(f/ax)i — (δ δ} +k | 
V1 + (f/ax)? + @f/ay)? 


Unfortunately, there are smooth surfaces in ®*, so-called one-sided surfaces, for 
which it is not possible to assign a positive direction. The most notorious example 
of such a surface (and aside from trivial modifications the only one) is the Mdbius 
strip I, shown in Fig. IV-4.* It is clear that 9% is genuinely one-sided in the 


F(P) 


FIGURE IV-3 FIGURE IV-4 


* August Ferdinand Mobius, German mathematician, 1790-1868. 
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sense that anyone who agreed to paint a single side of the strip would find that he 
had actually contracted to paint the entire surface. More to the point is the ob- 
servation that we can pass from one of the two unit normal vectors at P to the 
other by moving the normal continuously along a smooth curve on ov. Thus 
there is no natural meaning that can be attached to the integration of F - n over 31, 
and we must accordingly exclude the Mobius strip and its relatives from further 
consideration. To this end we introduce the following definition. 


Definition IV-1._ A smooth surface 8 in ®? is said to be orientable if the 
unit normal vectors at each point P of 8 return to their original positions 
after traversing any smooth closed curve on 8. If this property fails to hold, 
S is said to be nonorientable. In short, a surface is orientable if it 1s two- 
sided; nonorientable otherwise. 


Let us consider, now, an orientable smooth surface 8 in 61" with positive unit 
normal n, and let 


F(x, y,z) = P(x, y, Di + QO, ¥, 2)] + RO, », Zk 


be a continuous vector field on 8. Then the scalar function F - n is also continuous 
on 8, and the surface integral of F on ὃ is defined to be 


(F-n) ds. 
| n 


Moreover ifr = r(u, v) is a parametric representation of 8 with coordinate func- 
tions x(u, v), y(u, v), 2(u, Ὁ), and if the normal vector 


a(y,z). , zx), , 9%, y) 
d(u, v) a A(u, vy) ΕΣ δί(μ, Vv) ᾿ 


N = t, X te = 


of Eq. (IV-7) is a positive normal to ὃ (i.e., points in the chosen positive direction 
from 8), then the surface integral of F on 8 can be evaluated as an ordinary double 
integral over the domain D,, of r by the formula 


[[e-mas~ ff (eX) imi gua 
8 Re 


= ! (Ε - N) du dv 


| | ρ(ω 0) S22 + o(eu)) 5G) 


+ R(r(u, v)) -- aa Z "ἢ du dv. (I1V-13) 


iv-2 | SURFACE INTEGRALS OF VECTOR FIELDS 709 


Before considering examples, several remarks are in order. First, if the para- 
metric representation of 8 is such that the vector N = t; X ts does not point 
in the positive direction from 8, the above formula must be modified to read 


(F-n)ds = —|/ (F-N)d dv. (1V-14) 
| n) as I u av 


Second, if 8 is represented explicitly by an equation of the form z = I (, y) 
defined in a region R,, of the xy-plane, and if the upward direction from ὃ is 
chosen as the positive direction, then 


of. Of. 
N= xXtp=-Mi-Vi+k 


is a positive normal to δ, and we then have 


I (F-n) ds = | | P(x γ, £(%, yf — O(x, y, f(x, yx 


8 Rey 


+ R(x, y, 76, »)| du do. (IV-15) 
(This formula will prove quite useful later.) Finally, there is an alternative and 


very convenient notation for the surface integral of F on ὃ which can be obtained 
by writing 


i (F -n) ds 


ὃ 


[[ eit ΟἹ + Rk)-nds 
ὃ 


| P(i-n)dS + QO(j-n) dS + R(k-n) ds. 
ὃ 
For then 


i-n = cos7,, jen = COS Ya, k-n = COS ¥3, 
where 71, Yo, Y3 are, respectively, the Ζ 


angles between n and the vectors i, j, Κ 
(Fig. IV-5), and the quantities 


(i-n)ds, (j-n)ds, (k-n)ds 


can be interpreted as the projections of 
an element of surface area dS onto the 
three coordinate planes. This suggests 


that we set ἥ 
(i-n)dS = dy az, ie 
(j-n)dS = dz dx, 5 dy 
(k-n)dS = dx dy, FIGURE IV-5 
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and write {/, (F - π) dS as 
Ι P dydz + Qdzdx + Rdx dy. (IV-16) 
8 
The value of this expression is, of course, still given by ([V-13) or (IV-14).* 
EXAMPLE 1. Compute the value of 
[ (Ε - π) ds 
8 


when F = ΧΡΞΪ + k, and 8 is the surface of the unit sphere in 6. with the outward 
direction chosen as positive. 
Since ὃ can be represented by the equations 


x = cosu sin v, y = sinu sin v, Z = COSv, 


with 0 < u < 22, 0 < v < π, we obtain as in Example | of the last section 


ij k 

_ fax ay 82 
ΝΞ du du du 
ax ay az 

Ov Ov Ov 


= —(cosusin?vi + sin usin* vj + sinv cosvk). 


But this vector is clearly an inward normal to 8, and hence we must use (IV—14) 
to evaluate SJ (F -n)ds. This gives 


[[ © +n) as 
ὃ 


| | (sin? u cos u sin® vi + ΚΡ)" (cos u sin? vi 
Ruy 


+ sin usin? vj + sinv cos vk) du dv 


Ι 


x r2n 2 2 5 ; 
J [ (sin* ucos*usin’v + sinv οο50) du dv 
0 Jo 


I 


ae 5 Qa 9 2 r Qn 
[ sin v dof sin“ ucos* udu ΕἸ sin vcosv do [ du 
0 0 0 0 


os, 
15 


* The reader should not take these remarks too seriously; they have been given only 
to motivate introducing (IV-16). In more advanced work, however, the expression 
P dy dz + Qdzdx + Radx dy is given independent status, and (1V-16) is defined to 
be the integral of this quantity over the oriented surface ὃ. (See Fleming, Functions of 
Several Variables, Addison-Wesley, 1965.) 
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EXAMPLE 2. Find the value of 


dx d 
᾿ς 


when 8 is the triangular surface in Fig. ΙΝ--6. 
In this case ὃ is the portion of the plane z = 1 — x — y above the triangular 
region0 < x < 1,0 < y < 1 — xin the xy-plane, and (IV—15) yields 


1 1—z 
[[ xcaxdy = | ἢ ΧΙ — x — y)dy dx 
0 Jo 
ὃ 1 2 12 
| Ε - χῖν --χ ᾿ dx 
0 0 


1 
| ahaa ae ἐ: 
ἘΠ α — ax + x" )dx = 55 


EXAMPLE 3. Let F be the vector field associated with a time independent flow of 
fluid in a region of 3-space [1.6., F(x, y, z) is the velocity vector of the fluid at the 
point (x y, z)], and let 8 be an orientable smooth surface lying in this region. 
Then if F is continuous and n is the positive unit normal to § at a point P, the 
quantity [F(P) - nJ@(AS) is an approximation to the amount of fluid flowing per 
unit time in the positive direction across a surface element containing P, i.e. to 
the flux across AS in the positive direction. The usual limiting argument now 
applies and allows us to assert that 


[ (Ε- πὴ) ds (IV-17) 
8 
is the total flux crossing 8 in the positive direction. 


In an alternative computation of this same quantity, let us consider the rate at 
which fluid is leaving a small rectangular region B. For this purpose let | 


F(x, y, 2) = PO, », ZE+ OC, y, 2)] + RO, y, Dk, 


Ζ 


FIGURE !IV-6 FIGURE IV-7 
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and suppose the box B to have edges of length Ax, Ay, Az situated as shown in 
Fig. [V-7. Then the net amount of fluid leaving B through the shaded sides ‘is 
(approximately) 


P(X0o zi Ax, YOs Zo) Ay ΔΖ -- βίχο. YOs Zo) Ay Az, 


which, assuming continuous differentiability of F and using the mean value 
theorem, can be rewritten 


oP 
Pex, Vos Zo) + Ax ax (xo + @AXxX, Vo, 20) Ay Az — P(Xo; Yo; Zo) Ay Az 
oP 
ax (Xo + @Ax, Y0s Zo) Ax Ay Az, 


where 0 < 6 < 1. Similar results express the rate of flow through the remaining 
two pairs of parallel sides of B using 9Q/dy, 0R/dz instead of 0P/dx. Hence if 
B is small, the total rate at which fluid is leaving B is given approximately by 


8Ρ 80. OR 
(2 ay 2B ax ay δὲ 


[the partial derivatives being evaluated at x = (Xo, Yo, Zo)]. The quantity in 
parentheses thus measures the rate per unit volume at which fluid is diverging 
from the point x. It is accordingly called the divergence of the vector field F and 
is denoted by div F; that is, 


dive] -αρ 3 3 8--.- (IV-18) 


If the fluid is incompressible, then div F must measure the rate (per unit volume) 
at which fluid is being introduced at the point x. Therefore, if 8 is a closed surface, 
enclosing a region R, the integral 


(div F) dx dy d. 
! iV x dy dz 


represents the total amount of fluid introduced into the region R, and hence must 
also represent the total flux across the boundary surface 8. Comparison of this 
result with (IV-17) leads to the equation 


(F-n)ds = (div F) dx dy dz. (IV-19) 
I n) ds Π Ιν xX dy az 


This result, which would almost be self-evident if one were willing to accept the 
physical argument just given, is one of the basic relations in vector field theory. 
It is known as the divergence theorem and is proved below. 
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One final remark before leaving this section. Thus far we have limited our 
treatment of integration to smooth surfaces. There is no need to be quite this 
restrictive, and in fact we shall want to integrate over surfaces such as the surface 
of a cube, or the surface of a closed cylinder (Fig. I1V-8). Although not smooth, 
these surfaces are constructed from a finite number of nonoverlapping smooth 
pieces and are accordingly called piecewise smooth surfaces. The various integrals 
of these two sections are extended to a piecewise smooth surface ὃ simply by 
adding the integrals over the smooth pieces of ὃ. The only question which presents 
real difficulty in this connection is that of orientation. However, for a piecewise 
smooth surface 8 which bounds a finite region of ®°, i.e. which has an inside and 
an outside, the question of orientation can be settled by 
choosing the outward normal for each of the smooth pieces 
of s. A general discussion of orientation of piecewise smooth 
surfaces is quite involved and unnecessary for our present 
aims. The reader is referred to a brief but excellent treat- 
ment in Protter and Morrey, Modern Mathematical Analysis, 
Addison-Wesley, 1964, pp. 602-611, where it is proved that 
the formulas which we have obtained in these two sections, 
are in fact independent of the particular parametrization 
used to derive them. 


FIGURE IV-8 
IV-3 THE DIVERGENCE THEOREM 


In this section we shall establish the equality given in Eq. (IV-19) of the preceding 
section, known in the literature as the divergence theorem, or as Gauss’ theorem.* 


Theorem IV-1. Let V be a region of 3-space whose boundary OV is a piece- 
wise smooth two-dimensional closed surface, and let F be a continuously 
differentiable vector field defined in and on the boundary of V. Then if n 
denotes the unit outward normal to OV, 


| " (F-n) dS = | | i (div F) dV. (IV-20) 


aV V 


Proof. We begin by establishing ([V-20) when V is an “elementary” region of 
the type shown in Fig. IV-9, and then pass to the general case by decomposing 
more general regions into elementary ones. Moreover, to simplify matters even 
further we rewrite ([V—20) in scalar form as 


[| pavas + Qdzdx + Rdxdy = ΠΡ Bla 
oV V 


* Named in honor of the famous German mathematician Karl Friedrich Gauss, 
1777-1855. 
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and observe that the desired result will follow by additivity 
if we can show that 


[fsa |ff iter 


I Rdxdy = || of ἀν, | FIGURE IV-9 
av Vv 


And finally, since these equations are all of the same type, it obviously suffices 
to establish just one of them. 

This said, let V be an “elementary” region bounded above and below by smooth 
surfaces 81 and 8. described, respectively, by the functions z = fo(x, y) and 
z = f;(x, y) where (x, y) ranges over a region D in the xy-plane. Let $3 denote 
the lateral surface (if any) of V. Then, by Formula (I[V-15), 


[[ navay~ | (Rk) - nds 
52 


ἤως ‘fa; ὅδ᾽. uaa 


= ; | R(x, y, folx, y)) dA. 
D 


[ Rdxdy = oy R(x, y, filx, y))dA 
δι D 


(where the minus sign occurs because the positive normal to 81 points toward the 


interior of V), and 
ff nacay = γώ αν. 
$3 83 


since n is orthogonal to k on 83. Hence 


|| Rdx dy = ! [R(x, Vs Sol, y)) ἜΣ R(x, y, Si, y))] dA 


aVv 
fo(z,y) 
Hen 3 az RO: y,2)dz|dA = IE oF ἂν, 


as required. Thus (IV-20) holds for “elementary” regions V. 


Similarly 
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To complete the proof we now assume that V can be decomposed into a finite 
number of elementary regions Vi,..., Vn as suggested in Fig. 1Ν--10, and apply 
the theorem to each of them in turn. Then, since the integrals over those portions 
of the bounding surfaces common to a Κ᾽; and V; cancel in pairs, we have 


| I (F - n) ds > [[ (F - n) ds 
oV 


t=1 97, 


- > ff (div F) dV 
w=1 V; 


Π (div F) dV, 
Vv 


and (IV—20) still holds. Finally, for the most general 
regions considered in the statement of the theorem, 
we apply a limiting argument based on the case just 
considered.* J FIGURE IV-10 


EXAMPLE 1. Use the divergence theorem to evaluate the surface integral con- 
sidered in Example 1 of Section IV-2, i.e., the integral 


{ xy” dy dz + dx dy, 
ὃ 


where 8 is the surface of the unit sphere x? + y? + Ζῇ = I. 
By (IV—20) we have 


“ἂν ἀξ + dxdy = Σ dV, 
[fot ave + dear = ff 


and, changing to spherical coordinates, 
2x - 1 
| xy” dy dz + dx dy | | ᾿ (r sin φ sin 6)’r? sin φ dr ἀφ dé 
: 0 Jo Jo 
2a 


T 1 
= ἢ sin? 9 49. | sin’ ede: | γῇ dr 
0 0 0 


m(3)(3) 


ἘΠῚ 
15 


ll 


The economy of this method is too obvious to need comment. 


* See O. D. Kellogg, Foundations of Potential Theory, Springer, Berlin, 1929. 
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EXAMPLE 2. The divergence theorem can some- + 
times be used to evaluate surface integrals even 
when the surface in question is not closed. As an 
illustration of how this is done, consider 


// χγ dy dz + xdzdx + (x + 2) ἀχ dy 
8 


(Fig. [Νν-1 1), where 8 is the hemispherical surface 
z=vi1— x? — y4,z> 0. FIGURE IV-11 
To evaluate this integral let V denote the region bounded by ὃ and the plane 


z = 0, and let 8: denote the closed disc x* + y* < 1 in the xy-plane. Then we 
write 


"» dydz + xdzdx + (x + z)dxdy 


-- " ὧν dz + xdzdx + (x + 2) ἀχ ὧν 
+ ff dy dz + xdzdx + (x + z)dxdy. 


(The reader should note that the plus sign appearing here is not a misprint. Why?) 
But by the divergence theorem, we have 


[[ 29° aya + xdzdx + (x + z)dxdy = ! GO? + 1) ΓΚ 
av 


πὶ 
-Γ f ae [(r sin φ sin 6)" + 1]r’ sin ¢ dr ἐφ dé 


2r 9 πί2 . 8 4 2π r/2 . 1 9 
[ sin 949. [ sin edo: [᾿ r dr + [ do | sin ¢ ἀρ | γ΄ dr 
0 0 0 0 0 0 


2π 2π Ar 


15 3 5 
Finally, 


[[ὐφὰ + xdzdx + (x + 2) ἀχ ὧν 


δ] 
J] vot + a4 (x + z)k]-kds = I (x + z)dA 


x “tus 1 


V1—z? 1 
[ [ xdy dx = 2 xV/1 — x2dx = 0, 
—1 J/—V1—2? —1 
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and we have 


[ xy” ἂν + xdzdx + (x τ z)dx dy = a 


ὃ 


In Eq. (IV-18) of the preceding section we defined the divergence of a con- 
tinuously differentiable vector field by the equation 


where P, Q, and R are the coordinate functions of F with respect to the standard 
basis vectors in @°. Although this quantity is defined in terms of a particular 
coordinate system, its physical interpretation suggests that its values remain un- 
changed under a change of basis. We are now in a position to prove this fact by 
giving a description of div F which does not involve a coordinate system in @°. 
To this end we recall that if fis real valued and continuous in a region R of 3-space, 
the mean-value theorem for integrals asserts the existence of a point (x*, y*, z*) 
in R such that 


[[[ fox. Dav = Τοῦ, γ᾽, 2, 
R 


where V denotes the volume of R. Thus if x is any point in the interior of the 
domain of F, and ® is the sphere of radius € about x, then 


| | | (div F) dV = div F(x*)V., 
Be 
with x* in ®., and Ve the volume of ®.. Hence, by the divergence theorem, 


div F(x*) = + j (F -n) ds, 


IB, 


and passing to the limit as ε — 0, we have 
div F(x) = lim ΕΣ | | (F -n) ds. ({V-21) 
ε-»0 ε 
IB, 


Besides providing us with a coordinate-free description of the divergence of a 
vector field, this expression also allows us to recapture the physical interpretation 
of div F(x) given in the preceding section. Indeed, if F is the velocity field of a 
time independent flow of fluid, 

[ [ (Ε- π) ds 
ϑῷ, 
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is, aS we have seen, the flux crossing the surface of ®, in the positive direction. 
Hence, in the limit, ([V-21) measures the amount of fluid diverging from x per 
unit volume. 


IV-4 BOUNDARY-VALUE PROBLEMS REVISITED: UNIQUENESS THEOREMS 


In this section we shall finally prove the long postponed uniqueness theorems for 
boundary-value problems involving the wave equation, heat equation, and La- 
place’s equation. Each of these theorems is an easy consequence of the divergence 
theorem, or, rather, of two simple corollaries of the divergence theorem known as 
Green’s first and second identities. However, before we can state these identities 
in anything approaching readable form we must simplify our notation somewhat. 
This can be done very effectively by introducing the symbolic vector V (read 
“(61 where 

V= Le res es ([V-22) 

Ox oy OZ 

The rules for manipulating this symbol are perfectly simple and go as follows. 
If y is a differentiable scalar function, then 


dy. , dv 


: 0 
Wy = eit i+ Fk 


a quantity usually referred to as the gradient of Ψ or grad py. Similarly, if 
F = Pi+ Qj + Rk is a differentiable vector field, then 


oF = (214+ 254 2x) cit οἱ τ κὸ - 24% τ 
= div F, 
and finally 
i j k 
ΡΟ R 


dR δΟᾺ. aP a) (32 oF) 
oe ee ee pees gee eee Ὁ 
(3 2) δὰ (2 ax)? Ls Ox ὃν) ᾿ 
a quantity called the curl of F. Finally, carrying this notation to its logical con- 
clusion, we set 
av 8 6 
Viv = aya t aye ΟΣ 


and write V- V = V2. (The operator V? is sometimes called the Laplacian.) 


Ιν-4 | BOUNDARY-VALUE PROBLEMS REVISITED: UNIQUENESS THEOREMS 719 


Since V - F is just another way of writing div F, the divergence theorem may be 
rewritten in terms of V as 


il (F-n) ds = [ff (Ὁ - Ε) dV. (IV-23) 
aV V 


In particular, if w and v are twice continuously differentiable scalar functions in 
and on the boundary of V, and if we set 


| Ov. OU. Ov 
F = uo?) = (i + ay) + x): 
we find that 
V-F = u(V*v) + (Vu): (Vv) (IV-24) 


and that ([LV—23) becomes 
J [u(Vv)-n]ds = [ i il [u(V2v) + (Vu)- (Vo)] dV. (IV-25) 
oVv V 


This is Green’s first identity. To derive the second we simply interchange u and v 
in (ΤΥ--25) and subtract to obtain 


[[ tCve) — o(vuy]-nds = fff (wv) -- v(W?uy}av. ἀν-26) 
V 


aVv 


This done we now get on with the uniqueness theorems. 


Theorem IV~2. Let 8 be a piecewise smooth closed surface in @* surrounding 
a region V, and let φ be a real valued continuous function on 8. Then there 
exists at most one solution of the boundary-value problem 


V7u=0 inV, 


u=g ons. 


Proof. Let u; and we be two solutions of the given problem and set U = uy — ug. 
Then U is a solution of the boundary-value problem 


V7U = 0 inV, 
U=0 onS, 


and we will be done if we can show that U = Oin V. To this end we note that when 
u = v Green’s first identity becomes 


[ [ [u(Vu)+njds = [ | [u(V2u) + (Vu)-(Vu)] dV. (IV-27) 
av V _“ 
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Thus, by setting u = U, we obtain 


[[[tww-~woar = 0, 
V 


IN Ge) + Ge) + Ge) lar = 0 


and since the integrand appearing here is continuous and nonnegative everywhere 


in V, we have 
au\?- (9 ΟΥ̓ ε: uy 
3 τ oy . dzJ/ =a 


in V, This, in turn, implies that 


or 


everywhere in V, and it follows that U is constant in V. Finally, since U vanishes 
identically on OV = 8, U = Oin V, as required.* J 

We omit the two-dimensional version of this result, and go on to the corre- 
sponding theorem for the heat equation. 


Theorem IV-3. Jf 8 and V are as above, there exists at most one solution 
of the three-dimensional heat equation 


2 du 


-- 7? 
α΄ Ὁ u 


satisfying the boundary condition u(x, y, Ζ, 1) = F(x, y, Z,t) on 8, and the 
initial condition u(x, y, z,0) = G(x, y, 2), where F and G are preassigned 
continuous functions. 


Proof. As in the preceding proof let U denote the difference between any two 
solutions of this problem. Then U is a solution of the problem 


2 au ee 
at Vou; 
u(x, y,Z,t) =O ons, u(x, y, Z,0) = 0 

and (IV-—27) implies that 


{τυ + νυ! αν = 0. 
V 


* Recall that, by definition, the values of U in V must approach the prescribed values 
on 8 = 0V as we approach 8 along any smooth curve in V. (See Section 13-2.) 


Ιν-4 BOUNDARY-VALUE PROBLEMS REVISITED: UNIQUENESS THEOREMS 721 


But V2U = a?(dU/dt). Thus 


Π ΧΕ ἐπ wan er - Σὰ 
Is ae Ua . IvUl? av. 


Since U is continuously differentiable with respect to ¢, we can interchange the 
order of integration and differentiation to obtain 


4}} (4a2U) dV = I} Iw Ul? dV. (IV-28) 


I(t) = i i [ (4a2U?) dV. 
V 


or 


Now set 


Then (0) = 0, while 10 > 0 and I’(t) < 0 for allt > 0. A straightforward 
application of the mean value theorem then implies that J(t) = 0. Indeed, from 
the mean value theorem we deduce that 

A) - A) ro), 0<e<1, 


or 
I(t) = 1I'(6t), 


and since [(t) > 0 and /’(t) < 0, we must have J(t) = 0. Thus the left-hand 
side of (IV—28) vanishes, and it follows that 


{ ᾿ν υ]}} ἂν = 0. 


As before, this implies that U = 0 in V, and the proof is complete. ἢ 


(Note that this argument can be used equally well for any of the other boundary 
conditions considered earlier.) 
Finally we consider the uniqueness problem for the wave equation. 


Theorem IV-4. With 3 and V as above, there exists at most one solution of 
the three-dimensional wave equation 


20'u τ 
Or? 


satisfying the boundary condition u(x, y, Z,t) = F(x, y, 2, 1) on ὃ, and the 
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initial conditions 
u(x, y, Z,0) = G(x, y, 2), ἐν (x, γ, 2,0) = A(x, y, 2) 
in V, where F, G, and H are preassigned continuous functions. 


Proof. Once again, let U denote the difference between any two solutions of the 
given problem. Then U is a solution of the problem 


2 δ΄ 


2 
go 


u(x, y,zZ,t) = 0 onsS, 
Ou ' 
u(x, ), 2,0) = 2 Oy, 2,0) = 0 inV, 


and hence (IV-25), with u = δύ δι and v = U, yields 


WG νυ τ v (2 i): velar = {ΠῚ a VU: η 45 = 0. (IV-29) 


But 
δῦ voy _ τ ae πὸ {20}. 
Ot Ot ar2/ 2° διλ art 
and 
δὺ _ {a _lo 2 
v (2) νυ ὅσο VU = 5.3; IW Ul; 
so that (IV—29) becomes 


5 | | | E [Ὁ τ ivul?| dV = 0. (IV-30) 
J 


Thus the integral in ([V-30) does not depend on ¢, and since the initial conditions 
require it to be zero when ¢ = 0, we conclude that it is identically zero. This 
implies that 


and hence U must be a constant. Again using the initial conditions, this constant 
must be zero, and we are done. J 


As in the case of Theorem IV—2, we omit the lower dimensional versions of 
Theorems [V-3 and 1V—4. 
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answers to odd-numbered exercises 


Chapter 1 
Section 1-1 
1. (—1, 3), (—3, 9) 3; -Ξ, -2), (, 9) 
5. (—6, —3), (18, 9) 7. tan? x + 1, —tan? x -- 1 


10x + 5 2x + 1 
qi a. ae eG 
13. Yes 15. No; undefined at x = 0 
17. No; discontinuous at x = 0 19. No; discontinuous at x = 0 
21. (--3, —38) 23. (—2, --Ἠ199) 25. 4(1 + sec? x) 27. In (x + 2) 


11. No; undefined at x = 1 


Section I-2 
3. (a) (—1, 5) (b) (0, 43) (c) (0, —2) 
5. (a) —x? + 2x? — 8x + 3 (b) 7 (c) 3x3 — 4x2? -- dx + 5 
9. (a), (0), (ὦ, (©), (Ὁ) 


11. No; we cannot assert that x + 0 = x. 


~] 


| 


oO 


Section 1-4 
1. (a) No; not closed under addition (b) Yes; satisfies subspace criterion 
(c) Yes; satisfies subspace criterion (d) Yes; satisfies subspace criterion 
(e) No; not closed under addition 
3. (a) Yes; satisfies subspace criterion 
(b) No; not closed under scalar multiplication 
(c) Yes; satisfies subspace criterion (d) No; not closed under addition 
(e) Yes; satisfies subspace criterion 
7. (a), (0), (Ὁ 9. (a), (ὃ 11. All constant functions 
13. (a) x(ax + β) (b) (« + Dex + 8) (c) ax? + Bx + y 
17. If X consists of the two vectors (0, 1, 1), (0, —1, 1) and Y the two vectors (1, 0, 1), 
(—1, 0, 1), then S(& MY) is the trivial subspace of VU, but 8X M SY comprises all 
vectors of the form (0, 0, x3). If 2X consists of the two vectors (0, 0, 1), (0, 1, 1) 
and ‘y the two vectors (0, 0, 1), (1, 0, 1), then S@C NY) and δὰ M SY each comprise 
all vectors of the form (0, 0, x3). 
21. (c) Wi MWe contains only f(x) = 0. 
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Section 1—5 


1, 


(a) All subsets which contain 1, 2, or 3 vectors 

(b) All subsets which contain 1, 2, or 3 vectors 

(c) All subsets which contain 1, 2, or 3 vectors and which do not include both 
(1, 1, 1) and Q, 2, 2) 

(d) All subsets which contain 1, 2, or 3 vectors and which do not include (0, 0, 0) 


: No; (0, Z, —1) and (0, 35 — 4), or (0, 3 — 4) and (0, 2, —3) 
. i = 1(1, 0) + 0(0, —1) = cos A@(cos 6, sin θ) — sin 6(—sin @, cos 4) 


1 
a (a, 0) + 0(0, 6) = 10, 1) — 10, 1), 
= 01, 0) — 1(0, —1) = sin @(cos 9, sin 0) + cos 6(—sin 9, cos θ) 
1 
O(a, 0) + g Ὁ; 8) = 00, 1) + 1(0, 1), 
i+ j= 1,0) — 100, —1) = (cos @ + sin 4)(cos 9, sin @) 
+ (—sin 0 + cos 6)(—sin @, cos 8) 
1 1 
= —@, 0) + 50,8) = 10, 1) + 90, 1), 
a β 
αἱ -+ βΊ = a’(1, 0) — β΄ (0, —1) = (α' cos 6 + β΄ sin 9){cos θ, sin θ) 
+ (—a’ sin 6 + β’ cos 6)(—sin 6, cos @) 
ΞΟ = O18) 
a β 
= a’(1, 1) + (--α’ + 6/0, 1) 


Comte 


. ώ. 7. 1 3) = —1d, 0, 0, 0) a 5(0, 1, 0, 0) =: 2(0, 0, 1, 0) ΞΡ 3d, 1, 1, 1) 


τ 0(1, 1, 0, 0) ΞΕ 3(0, 0, 1, 1) = 2(~—1, 0, 1, 1) + 2(0, =I, 0, 1) 
_ 2(2, —1,0, 1) ae 0d, 3, 2,0) air 1(0, =, —1, 0) 1(—2, 1.2, 1) 
= --ἶᾺ, —1, 2,0) + O(1, 1, 2, 0) + 3G, 0, 0, 1) — 3@, 1, —1, 0) 


15. x7 = 3x? — 23 + 40), 
x8 = 23x? — $x) + το) 
21. x8 = x(x — 1) — 24+ 32χ6α -- 1) - x, 
x? + 3x -- ῤὀῖ = x — 1) -- 24+ 3x@-14+4 -1 
- 23. (a) x8 + 2x - 5 = 1x? + 2x 4+ 5) 
(b) x? + 1 = 43x? + 2) + EO) 
(c) 2x3 — x? + 10x + 2 = 2(.8 + 2x + 5) — 43x? + 2) + 16x) — FO 
Section 1-6 
1. (a) —1, 1, 0 3. (a) (2, 1, 0) 
(Ὁ) —3, 0, 1 (b) (4, 3, 3) 
(c) 0, -1,1 (ὁ) 2,1, =) 
(ὦ —3, —4, 1 (d) (7, 8, 3) 
(e) 6, —4, 2 (ε) (6, Zz 0) 
(f) —2, 1, 2 (f) (10, 6, 3) 


5. One such basis is (—3, 0, 0, 0), (0, 1, 0, 0), (0, 0, 2, 0), (0, 0, 0, —1). 
7. Yes; one such basis is (4, 0), (0, 4). 
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Section 1-7 
1. (a) 2 (b) 3 


3. (a) One such basis is 1, x. 
(Ὁ) One such basis is 1, x, x7,..., x” 


5. (a) 3 (b) 2 7. 2 
9, One such pair is x3 = (1, 0, 0, 0), x4 = (0, 1, 0, 0). 


—1 


Section 1-8 
1. A’B’ and A’’B’”’, where, for example, 
= (2,1), B’ = (4,1), A” = , 2), BY” = G, 2) 
3, A’B’ and A”’B’”’, where, for example, 
A’ = (2, --1Ὲ, 8’ = (4,1), A” = (, 0), BY = (, 2) 
5. A’B’ and A’’B”, where, for example, 
= (1, 2), B’ = (—2, —1), A” i (0, 3), 8’ ΞΞΞ (-- 3, 0) 


7.0 
9. v(OE), where O = (0,0), E = (- ξ, —3) 
11. (3, 0) 13. (--3, -- 4 15, (—13, —6) 


17. v(OC), where O = (0,0), C = (2,2) 

19. v(OC), where O = (0, 0), C = (—11, 5) 

21. (x3 + χὰ — x1, 93 + yo — y1) 

23. v(OE), where O = (0,0), Ε = (x2 — x1 + x4 — %3, ¥2 — γι + γὰ — V3) 


Section 1-9 
3. m = 2: [0] = {2k} = {0, +2, +4, +6,...} 
[1] = {2k + 1} = {41, +3, +5,...} 
m = 3: [0] = {3k} δ +3, +6, +9,...} 
[1] = 3k + 1} = {.., -, —5, —2,1,4,7,...} 
[2] = {38k + 2} = {..., —7, —4, —1, 2, 5, 8,...} 
m = 4: [0] = {4k} = {0, +4, +8, +12,...} 
[1] = (44K + 1} = {..., —11, —7, —3,1,5,9,...} 
[2] = {4k + 2} = {0, 42, +6, +10, . Ἢ 
[3] = {4k + 3} = {..., -ϑ, --5, --ἼῸ, 3, αι 
Chapter 2 
Section 2-1 


1. Central reflection in the origin 


3. Compression (toward the x; axis) by a factor 4, followed by a magnification by a 
factor 2 


5. Rotation through 45° followed by magnification by a factor 2 
7. Reflection in the line x2 = —x, 9. The whole plane is mapped on (0, 0) 
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11. Not linear 13. Linear 15. Linear 
21. A(x) = cx, c an arbitrary real number 


Section 2-2 
5. (Ὁ) If2XC = {0}, then G(X) is the space of all linear transformations from Ὃ 1 to V2; 
if = V1, then @(X) contains only the zero transformation. 
Section 2-3 


3. (a) LDy(x) = y(x) — ya), DLy(x) = yx) 


() τ᾽ δ γοῦ = 9) - γῷ + YOR - + BE a 
(n—1) 
y (a) n—1 
+2 Oe a] 
D"L"y(x) = y(x) 
5, (a) x?D?2 + 3xD+ 1 (Ὁ) 2xD? + (1 — 2x)D — 1 
(c) 2xD? + 20 — x)D — 1 (4) x2D? + 2x(1 — x?)D — 6x? 


(e) x2D2 + 2x(2 — x?)D + 2 — 4x? 
7. (a) 0, 0, 0 
(b) 0, —6 sin 2x, 26: 
(c) —3 sin x — cos x, —2e%, 2 — 2x — 2x? 
(d) 0, 0, 2e—?7 
(e) 4x2, 4x? — 2/x, e™(x? + 2x — 2) 
11. If B = O, then the subspace is U; if B = J, then the subspace contains only O. 


Section 2-4 
1. (a) (A) = 9; Ag!(1, ¥2) = (391, — 392) 
(Ὁ) IU(A) is the line xz = 0; there is no inverse. 
(Οὐ 9U(A) is the line x1 + x2 = 0; there is no inverse. 
: + - 
(d) 9(4) = 0; 4΄0:,.»») = (ts, oo) 
3. (a) NA) comprises all constant polynomials; there is no inverse. 
(b) 9U(A) = O; there is no inverse. (A is not onto.) 
(c) It(A) comprises all constant polynomials; there is no inverse. 
(4) τω.) = O unless g(x) = 0, in which case (4) = Φ; there is no inverse. 
(A is not onto.) 


5. a1B2 — αὐβι # 0 
Section 2-5 
3. Representation of aA is Ee op : . 
ad, apo 
. _ {αι tat Bit Bi\. 
Representation of A + B 15 . (αἰ Bo + 8 


_ faa, + βιαὸ αἰβιί + 8182 \_ 
Representation of AB is (τ + Boos a8 + BoBs 


5. dim £(R2, 6.2 = 4 
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Section 2-6 
1 1 0 1 0 1 
1. (ay l1 0 1 (b)]O 1 -1 
0 0 O Q --| 1 
3. (a) (4, ἐ,ξ (Ὁ) (4, —$, -— 
0. π-πί 0 0 0 0 
0 Q —2 02 4 
5. (Δ } 0 4 9 Oly 1 6 
0 0 2 0 0 2 


7. If @1 = {e1, e2,..., en} and Bo = fej, οὐ,.. 


A(x) = A (Σ τὴ - 3 (> cups) οἱ 


j=l i=1 
Section 2-7 
—2 1 --ό 
1 3 7 “--1ῷ, 3. 2 
4 —8 8 3 
12 1 1 8 
9 4 3 3 
ee τ ἀπὲ 
-ἢἜ te 4 0 
—1 -—2 --2 
1 1 0 
7, For standard bases, 0 1 1? 
0 0 1 
0 0 0 
1 2 0 
for bases @1, G2, 012 
00 1 


1 --Ἰ 0 
(c) }1 2 1 

0 0 0 
(c) (4, ~ 4: —;'5) 

0 3 6 

0 4 14 
Oly 1 8 

0 0 2 


.,e&,}, then 
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11. If By = {(e11), (6:2), (691). (€22)}, Bo -- {(6..). (612), (613). (6λ1). (e9), (e43)}, 


0 0 0 


then [A: @1, Be] = 


ooo © 
oOo fF Oo © 


0 
2 
13, (b)| 0 
0 
0 


SOS Sis 
| 
WwW 
| 
ΒῸΝ 
ΟὟ. 


15. mp(x) = 
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Section 2-8 
18 —16 10 0 
1. (a) | 19 11 (b) Product undefined (c) {0 1 O 
31 —25 00 1 
8 2 —4 12 
0 0 0 0 
(d) @) Oy ὦ Gener ὁ 
—2 --ἃἰ 1 --3 
3, Qa12 = a21, 0r else Q11 = a22 and Q12 => —aQ@21 
x ἃ 2 Ὁ ¢ 
5. @| 2 ὶ (Ὁ) | --ἰ 1 —1 
et « SS ey 0 1 
2 2 
Sas .5. _3_ 
i3 i3 13 
©|-% fm ΞΣ 
meso pe Serene 
18 i3 13 
7. (a) Invertible if and only if a8 ¥ 0; 
_2 1 
inverse aR ie 
2: iG 
a 
(Ὁ) Invertible if and only if a@(8 — a) + 0; 
Se ay Tara th 
inverse a 2) ae @) 


_ ἃ ΕΝ 1 
βίβ — a) B(B — a) 
(c) Invertible if and only ifa + 0; 


9 8 1 
a a 
inverse}0O —1 0 
1 8B _t 
a a2 az 
α β 


1 ἐν 2 : : 1 1 0 d =1 0 3 
9. a α] να: arbitrary except that@ γέ O;also}|,, _,|and| 1 1 


1 — 0 
Y arbitrary; F ᾿ and : os 4 


β 
0 0 
, a, 6 arbitrary except that 6 ~ 0; also E ἢ 
στ α 


ζὸ 


Ύ =~ Ο but otherwise arbitrary 
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13. 


0 -1 —6 0 1 0 
sof] oft] abe 
17. One such pair is 4A = ; Af B= ie “1: 


19. (Ὁ) An n X n diagonal matrix (α;;) is invertible if and only if a, ~ 0 for 
i= 1, 2,..., π. The inverse is an n X n diagonal matrix (aj;) in which 


S-6.0' 

CONS 
| 

om Om 


/ δ 
ay = 1/a:;, C= 1 Dogue nog Re 


(d) The matrix is an n? X 1 matrix with entries corresponding to the n2 matrices 
(e,;) of the image basis. Those entries which correspond to (611), (e22), (635), 
. +» (θη) are each 1 and all other entries are 0. 


Chapter 3 


Section 3-1 


1. (a) 6e2* (Ὁ) 2cos x — sinx 
(c) 2 — 2xInx (d) 2e7(x sin x — 3 sin x — 2x cos x) 


3.4. - 3,b=0,c¢ = -ἰ 
5. D(xD) = xD? + D, (xD)D = xD? 
7. (a) (a1D + 1)1D + 1) = (ai + 6))D + 1, for given a; and δ1 
(Ὁ) D and \/x D are each linear on [0, ©) but D[\/x D] is undefined at x = 0. 


9, (a) 3xD + 2 (Ὁ) (εξ + e-*)D? 
(c) xD + Dx +1 
13. (a) (Ὁ — 1)(D — 2) (b) 2D + 1)(D + 2) 
(c) 2D + 1)? (ὦ (D + 1)(D — 2)? 
(e) (Ὁ — 1)(D + 2429 + 1) (Ὁ (D — 1) ῦ + 1)(D? + ἡ 


(g) (D? + V2D - 1)(D? -- V2D4+ ἡ ᾿ 
(8) [Ὁὃ -- 1125 — 3 + V5) D + 1123 -- 40. — V5) D + 1] 


19. (a) Σ᾽ ciaix* where co = 1, cc = K(k — 1)--- (kK —i + 1), 1 =1,2,3,...,0 


i=0 
Section 3-2 
1. (a) 2 (b) 3 (c) 3,3 (d) 2 (e) 3, 3,3 
3. (b) y = ce cos bx + coe sin bx 
b 1 
(c) y = be* cos bx — sO) 


e* sin bx 
b 
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5. (a) The given solutions are not linearly independent. 
(Ὁ) y = ει sin? x + ce 
7. (a) y = οι sinh x + c2cosh x 
(Ὁ) y = cyx? + cox? In x 
(c) y = εἰ sin2x + c2 cos 2x 
1 
(d) y = cix + cox In τ = 
Section 3-3 
1. y = > on (~~, 0) or (0, ©) 
ς 
3. y= τὰ χ᾽ ONE « χ « (k + 1)π, k = 0, +1, +2,... 
5. ysze ot ceo, on (—, ©) 
7.1 ΞΞ eo + ce “/™* on (-- οο, @) 
R 
9 = ce” — (2x + De on (-- οὦ co ) 
om A(x2 + 1) 
“(x — 1 
11. ν Ξ ied rn ΤῈ <x < (kK + 1)r,k = 0, +1, +2,. 
x sin x 
1+vV1— x2\_- 
13. y = ἘΠ. (ε΄ + c), on (—1, 0) or (0, 1) 
sinx + In ]1 — sinx| +c 
15. y = -- -- ------- ---------ς----- 
(1 + sin x)? 
2k -- 2k 
on a Dig eo κὲ Ἢ ἐπι k = 0, 1,42... 
17. y = (sin x In |csc 2x + cot 2x| + ¢ sin x)~* 
For a given c the solution is valid on any interval which does not include any point 
ka /2,k = 0, +1, +2,...,0r at which the quantity in the parentheses vanishes ; 
y = Οἱ also a solution on the intervals kr/2 < x < (k + 1)n/2. 
19. y = ΕἿΣ ΒΝ c(x” + 5: ue on (—%, ©) 
ee eee xo - 6x) 3 (χ' -- 12x) 1 3x” — 72x + \ 
eT 2 Inx 2 (nx? 4 (In x) 
on (0, 1) and (1, ©) 
23. y = {1 — ie + 4ln(—x + Vx? — 1ὴ] -- να - 1°, on (-- ὦ, —1); 
y= -ἰτφ ἰἨᾷ — Χ)ς + Δ cos xJ+tv1 - x2)" on (—1, 1); 
y = τὰ -- Die + $line + V2 — DI -- Vx? -- 1)’, on (1, &); 
also, y = Oisasolutionon --ο < x < ©. 
5 
5.) SSS εοετ εξ 
x38 + 5x + cv |x| 


For a given c the solution is valid on any interval on which the denominator 
nowhere vanishes; y = 0 is also a solution, on (— ©, ©). 
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27. (a})y = — ° + 1 ο 12 dx: on (-- 0, 0) and (0, ©) 
2 
(b) ya) = —6.3407, γ'΄(() = 6.9472 
1 2x 
= ee 31. y =x ae 
29. y i+ i yh ee y “ἘΠ ra 
_ (Ο5Χ —sin?z 4\—1 
33. y= pcre |e 5) 1 
35, (Ὁ) ὦ ν - ΒΕ 
᾿ γτι- ce’ ᾿ 
1251 
ud _ 3 fce + 1\. =e 
1 
oo = ΓΕ ΒΝ 
(iil) y 1+ pine also y 
1 (2ce°!* + 3 
(iv) y = 7 (ote a salsoy = 3 
2 x aby 
37. υ' Ae" —1=0,v=1 Ἐπ og ee = 1; y = ce + cee 
39. (a) y = cye2* + cee?* 41. (a) ce? + coxe 
(c) y = cie7* + coe?" (c) cye8/2)? + coxel3/%)# 
(e) y= cye—(V6/2)2 fe οοοί 612)» (e) cye(V2/2)« Ἔ οοχοί 212). 
Section 3-4 
1 
ly = — Fg7onx > 0 
ἡ pee τ ae es on ee) 
ee | © dx, on (—7, 0) 
x sin x J_1/2 x 
1 ee [ Best sin x) In F891 on (0, π) 
sin x 3, 
x—1 
.y = βξίη---ς-- -- - 
2 : ae 
11. ν 2)- 9+ V30 oy + V3 * cos x) on (0, 0) 
TX 12 4 
13. y = (1 + 21n2) — 21n|x|, on (—~, 0) 
15. The equation xy’ + y = Ὁ is of the first order on (~~, ©) but is not normal 


23. 


on any interval which contains x 


condition y(0) = 


0. If y(x) is any solution then the equation 


implies that y(0) = 0, and so if yo γέ 0 there is no solution which satisfies the initial 


G is the linear operator which transforms h(x) into ek) | gts dx + yoe**—*0), 
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Section 3-5 


1. 


(a) Interval is (--- οο, ©). 
(b) One representation of y is 
y = οι "1 + coe 4+ ce". 
(c) γι = 1, yo = αὶ — Be + Ge, 


Ys Ξ ΞΈΡΕΙ δ ge" 
3. (a) Interval is (—«, ©). 
(b) One representation of y is 
y = cye® + coxe® + cze* cos x + c4e* sin x. 
(c) γι = 2e* — 2xe? — e* cosx + e* sin x, 
yo = —2e* + 4xe* + 2e* cos x — 3e* sin x, 
y3 = e* — 3xe* — e*cosx + 3e*sin x, 
γ4 = χοῦ — e*sinx 
5. (a) Interval is (0, ©). 
(b) One representation of y is 
1 
y=C1 (: + ‘) + c2(3x”). 
2 2 
x Z x 1 
(0) γι πο τ la 
Section 3-6 
1. W[1, e-*, 2e2*] = —12e" 
(3, WE, x, x?,...,x"] = 1!-2!-3!---av! 
5. WIxl/2, x 1/3] ot —gx—1/6 
7. W{e*, e* sin x] = e* cosx 
9. W[1, sin? x, 1 — cos x] = 2 sin® x 
11. ΨΙ͂ΜΙ — x2,x] = 1.1 —- x? 
23. ὦ - = FOO) — Oa) 
uy(x)uo(x) — u2(x)u'i(x) 
μι (χα) (x) — ιἀ(χ)ι() 
αοὐ(χ) = ee 
ur(x)u2(x) — u2(x)ui (x) 
25. (a) x2y"” — x(x + 2y’ + (x + 2y = 0 
(b) x?y’” — 2xy’ + 2y =.0 
(0) γ΄ +y =0 . 
(d) (x cos x — sin x)y’’ + (« sin x)y’ — (sin x)jy = 0 
(e) x21 — Inx)y” + xy’ - y = 0. 
Section 3-7 
1. (a) —1/x 7 (b) —4/(1 — x?) 
(c) 2x3 (d) —1 
(e) e-cos= | (Ὁ ef 2/3) +23) 2 21/2] 
1 x 
ee 7 1. --1 + =ln 
2 ὰ * gin2 x 3 2 


i+ x 


1—*x 
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Chapter 4 


Section 4-1 


3. 
5. 


x2 — 2ax + (a? + Ρ2 = 0 


(a) (D + ) + 2) 

(b) ὦ — 1)(D? + ἡ 

(c) ὦ + V5)(D — V5)(D? + 2D + 5) 

(4) (Ὁ + 1)(D — 1)(D + 2)(D — 2) 

(ec) (D2 + V2V10 — 2D + V10)(D? — V2V10 — 2D + V/10) 


Section 4-2 
1. y = cye7?* + c2e* 
3. y = cye32/4 + ege752/2 
5. y = cy cos2x + cz sin 2x 
7. y = cie~?* cos 2x + c2e—2* sin 2x 
9. y = cie*cosx + c2e* sin x 
11. y = cye7* cos /3 x + cee? sin V3 x 
13. y = cje2V 32 + coe ¥ 32/2 
V2 V2 
15. y = cye%/ cos τ x + coe(3/8)2 sin τας x 
17. y = & — ζχ)εῖ5 
19. y = 2cosV2x 4+ 2sinvV2x 
21. y = --ξο 21 sin 3x 
23.» τ 3xeV52 
" 2 
25. ν = ν,2 e222 (cos » + sin x) 
29. (a) νγ΄ + 6y’ + 9y = 0 (Ὁ) »" — 2 + Sy = 0 
(c) »" + 4+ 4y = 4 (d) γ΄ + 4y’ + 3y = 3x + 16 
(Ὁ ν΄ + 9y = 3x 
31. (Ὁ) y = εἰ cos (2x + 69) 
33. (a) y = e* cos 5x + Ze” sin 5x 
(b) y = (4 -- ode 1507 + (ᾧ + oie” 
Section 4-3 
1. y = cye™ + coe* + cze7** 3. y = οι + (co + cgx)e78/2 
5. y = cye—2* + coe?* + 46. (112)ς 7. y = ει + cox + cze7* + c4e? 
9. y = (ει + cx) cos 3x + (c3 + c4x) sin 3x 
V/3 3 
11. y = cy + cox + ε536. (112)ς cos πα + cge—O/2)= sin ae 
13. y = (ει + cox + c3x? + c4x)e* 
15. ν = (ει + cox + e3x2)e—2* + cacos ν 3χ + c5 sin V3 x 
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17. (a) (ὃ — 1) (Ὁ) D? -- 40 Ὁ 8 (c) (D? + 1)8 
(ὦ δ.) + 2) (e) (D? + 4)° (Ὁ (D? — 2D + 5)? 
(g) (D? + 1)? 
(h) (ὃ — 3)?(D? — 6D + 10)? 
(i) D(D — 1)?(D — 2)3(D — 3} 
(j) τὶς 22 1)"(D = 2)»τ1 δι τος (D ae kn +l te (D = n) 
21. (d) The results of (a) and (b) show that the solutions are linearly independent in 
C(— οὐ, 0). 


Section 4-4 

(Note. Sometimes a simplified particular solution may be obtained by deleting from the 
solution given by variation of parameters, or the use of Green’s functions, any terms 
which satisfy the homogeneous equation.) 


1. y = (ει + In |cos x|) cos x + (c2 + x) sin x 
2x — 1 
35.» = 32 e?* + (οι + cox)e—** 
5. y = te (/2)2(_x sin x — 2cosx + δι + Cex) 
y= oy (Te?* — 14 — 3.3 + cye( “5 +V3802 as coe -ὅ-- Υ 87): 
9. y = te7*(sin χ -- 2005 x) + cie*cosx + cze* sin x 


11. yp = χϑίξιηαχ — Ὁ 


1 cos” 2x 
13. yp = Alin [tan x| + (cos 2x) In (1 + cos 2x)|sin sa 
Soy. 17. K(x, ἢ = He"? — οὐ 
z—t - — 
19. K(x, ἢ = 2e"~*sind(x — ἡ 21. K(x, ἢ = ae 


ΐ 


23. K(x, t) = 


1 τ oa + x)1 -- + 
4 — x) + 2) 


25. Ifa τέ Oorifw ~ ρ΄" — a’, then 


_ 1 [sin @e + 1) _ sin @t + 2) 
δι 2. 
1 ἴω sin (ct — g1) , sin (er + 3: 
δι Do 
where 
— (b? -- ἃ}. δι τ’ [a? Ἔ (w + δ)...“ D2 = [a? oe (w = eee, 
and 1, ¢2 are determined by the relations 


cos φι = (w + c)/D1, sing; = a/Dy,, cos yo = (w — c)/Da, 
sing2 = a/D2, 0< ¢1, v2 < 2m. 


Ifa = Oand w? = b?, then 


») = 579 (Sin wt — wt cos ot). 
2w 


Section 4-5 


1. y 


oy er ae 


y 
y 
y 


9. y 
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(4x3 ~ 4x2 + 4x — 3)65 + cie~* + (62 + cax)e? 
— (4x3 + gx? + Bx + ἢ) + οἵ + cox + ese 
sic(4 cos x + 3 sin x) + cie? + c2e** + eae? 


£cos x + οἱ + c2e7* + 6867 


x? 
€ se Ὁ οι) ' + c2 + €3x + cae 


11. Κα, = e*§-@-)-1 
13. K(x, ἢ = 3[οτ-τὸ — 2e2@-9 +4 e8@—H] 
15. K(x, = sinh(x —) - (X- ἢ 


Section 4-6 


ly= 


3. y 
5. y 


Tl. y 


Section 4—7 
1. Wp = 


3x + κι fe-@!”) dx + ko 
kyx? + ke 
x3/2(ky nx + ke) x > 0 


= 9 Slat) /ay (2) de | | h(x) ellao/ay (lar ν «| 


a\(x) 


dx : _ aed eee 
9. Let γι = Jo) | sim 91 = a a ea 1 
305 + x? — 2x 3. yp = 4cosx — ¥sinx 
—4xe—2% 7. Yo = (x? — 3x + 3? )e* 


5. Vp 
9. Vp 
11. yp 
13. Yp 
17. yp 
21. yp 
23. Yp 
25. Vp 


27. Vp 
29. Yp 


Section 4-& 


1. y 
3. y 
5. y 
7. y 


εἶς (899 + 1305x + 675x2 + 125x3) 

ταῖς (2374 — 2940x + 3200x? — 1500x3 + 625x4) 

4(x — 1)65 15. yp = 2 + 2x + χε τ 

— (sin x + cos x) 19. yp = τ (B9x + 9x? + 2x3 4 12xe*) 
(ει + cox)x2e2* + (63 + cx + c5x”)cosx + (ce + c7x + cgx?) sin x 
cye7* + x3[(co + 3x + c4x?) cosx + (c5 + cox + c7x?) sin x] 


x7[(c1 + cax)e* + (63 + caxde* + (c5 + cox + οὐχ + gx?) cos x 
+ (cg + c10ox + c11x7 + c12x) sin x] 


x3(c1 + cox + c3x2)e? + (ca + 5x) cos x + (cg + c7x) SIN x 


C1 + cox + x%e7/2[(c3 + cax) cos x - (c5 + cex) sin x] 
+ (c7 + cgx + c9x2)cosx + (c1o + ¢11x + €12x?) sin x 


e1|x| + e2|x|~? 

εἰ sin (3 In |x|) + ce cos G In |x}) 

ci|x|? + colx|-?, if p σέ 0; y = οἱ + co In |x|, if p = 0 
[x|-1(e1 + c2In |x|) + calx|’ 
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9. y = οὐχ "3 + calx|¥? + e3|x|-¥? 
11. y = cx|x| + ce|x|/-! + 63 cos (in |x|) + ca sin (In |x|) 
13. Letd = (αι — 1)? — 4ao. 

(i) Ifd > 0, seta, = 8{| — αἱ — Vd], 


Ι 


= 41 -- αἱ + Vd]; then Κα, ἢ = xe = 7 
a2 ΞΞ 9 al 3 Xx, = Ja re 
(ii) If d = 0, seta = (1 — a)/2; then K(x, ἢ) = xi. 
(ill) Ifd < 0,seta = ee b= v="; then 
K(x, 1) = cos [δ x — In 2. 
17. (a2) ( Ὁ + 2)xD — 1) (Ὁ) (xD + 3)@D — 3) 
(ἡ Ὁ + 1)2(xD — 7) (4) (Ὁ — κα} — 2} — 3) 
(e) (x? D2 + xD + 1) Χ} + 1)«D — 1) 
19. y = —2(In x) cos (In x?) 21. y = 43x 
Section 4-9 


(Numerical values are approximate) 
1. (a) x = χρο Min 2)/56001¢ — yx ge—9.00012¢ 


(Ὁ) ¢ = 18,600 
3. (a) x = (xo + 72.13k)e—0-91386t — 72.13Κ 
 ἐΞ In (xo + 72.131) — In (72.13k) 


0.01386 
5. 132.9 hours 


7. (a) 9.00 years 
(b) 221,000,000; 856,000,000 


9. r = ro — kt; evaporation complete when t = ro/k. 
11. h = hocosvW/2g/Lt 


Section 4-10 


L _ Pe ove 
19 See oe a ‘sin (bt — 8), 


where Y = \/(R — aL)? + 6212, R — aL = Ycos 8, 


δ], = YsinB,0 < B <7. 


3. (a) q = 0.03e “ΠΟ 
(c) 3.5676 volts 


5. If R 21,0", setA = [R® — (4L/C)]'””; then 
_ —{R/(2L)}t A, Δι]. 
q = 0.03e cosh 5 zr! + x sinh 57. ( 


If R = 21) 0 "5, then g = 0.03[1 + (R/2L)e OP 
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2 
IfR <2 (£) set A’ = [(4L/C) — ΕἼ: then 


-" —[R/(2L)}t A’ Rs Ae). 
q = 0.03e co 57, t+ Δ’ sin ar! 


t wEC : t EC . 
7. G) ᾳ = 4(0) οος Sie + Vic | 0) — Ε΄: 5 sin τ + Ta She sin wt 


34 1|. E |. E 
Gi) g = q(0) cos wt + 10) +- Z| sin wt οἷ “95 wt 


(Resonance in this case) 


Chapter 5 


Section 5-1 


1. (a) Piecewise continuous on [0, ©), from definition 
(b) Piecewise continuous on [0, ©), from definition 
(c) Not piecewise continuous on [0, ©), since function becomes infinite at ¢ = 1 
(d) Piecewise continuous on [0, ©); note that 
t—2 t—2 1 


lim, —————- = lim ------ο------- = -- 
9.9} 12 —t— 2 2 12--{-- 2 3 


Note that the function, as given, is not continuous on [0, ©), since it is unde- 


fined at t = 2. 
(e) Not piecewise continuous on [0, ©), since it becomes infinite as t — 0 
4 2 
1. - . πξ 
ΐπ 3 3 


11. lim, (¢ sin 1/t) = 0; t sin 1/t is piecewise continuous on [0, © ). 
t—+0 


Section 5-2 
1. Lff] = _ > So = 0; abscissa of convergence is 0. 
1 or ae | 
3. LL f(s) = 7a —e )ifs #0; L[f]0) = 1;s0 = -—~ 
. a 
5. £L[sin at] = τ τ αδ᾽ Ὁ = 0 
Section 5-4 
cosa + ssina 
1.----.ςς-- 
52 + 1 
Pi ΕΣ. π᾿ ii 1 
2: Ξε εῖξας, Ξ: τς τε, ὅρος wee a ον 
ἡ Ε + (n — 1)!s2 τὰ (n — 2)!s3 " τ 1!.55 ΗΝ 2 
2 
5 2a 


᾿ 52 — @? i “(52 + 4a2) 
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4s 1 _ 
Oi ae me as 
(2? + Δ} 13. 7° 
17. If | f(t)| < ρ΄" then lime f(t) = Ο [ἢ 5 > a. 
t—00 
21. y = 62: + 26! 
23. y = —$ + ge* + {3 cos 21 + 2 sin 21 
25. y= -- 11:2 + ze! _ ὃ. 3: 
27. y = —2 + 2cos $t + sin $t 
Section 5—5 
3 72s(s” — 9) 
(5 — 2 +9 "(52 + 9)4 
5 (s + 3)cos4 — 2sin4 
(s + 3)? +4 
7. If £Lf] = o(s), then L[te*’f(r)] = — ἴ ΞΞ 2) = ols — 2) + os - 2) 
; Qs 4 2)e~*!? ‘i — a 
2s2 " 52 + 1 
1 Bs —3s8 —4s 2 
13. τὰ [1 4e + 4e e | 15. ὩΣ +4 
1 l1+e” 2(s — 2) 
ἘΞ ( - <=) 19. 7 — 22 + IP 
i 8(5s° — 1) . 2(cos1 — sin1) 
(5. τ 14 58 
55 3s* — 165° + 96s — 108 ἡ ἢ n εἶ“ sina — 5asina — cosa) 
" (s — 1)2[(s — 3) + 1) 5(s — 1)? 5(s — 1)? 
_ st = 165° + 120s” — 400s + 460 | e“(2sina — Sasina — cosa) 
S[(s — 3)2 + 13 S(s — 1) 
25.1 ee 27. 1 -- te?! - tte 
1 pe | a —2t_: 
29. i= ΤΠ ΐ : 31. te ; sin 51 
33. ¢sint 35. 3sint + $tcost 
Ι 0 iff S 2, 
37. Ν τα δῆτ ὦ ~ 2) =) sin = (¢ — 2) ifr > 2 
. 3 
39. ---- : Gis -- ΤΕΣ ἘΠ 
V2 “2 τς ὩΣ. V2 
Aan ᾿ ts, 
2 Ake 1 
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t t t 
τὴ 5 1 
ry Sar ne ty Pah ὦ ταν ear = —_—-, Sige * ee 5 > 
49. (b) £ a en Sea Ι ᾿ Ι t Ι tsinat dt dt...dt, n> 2 
-.--.,.- 


n—1l times 


Section 5-6 


l. y = ge — Ge — 516 


“2 


= Di hae 
3. y = Re‘ cosW/2t + 3 ¢ ‘sin/2t+t— ΓΙ 
Le —hkt 
5S p= -—-f1 — 
y au e | 
Ὡς 7 —k{t—j) 
ἜΣ 2 (=1)'uj(Q -- ey 
7. y = —2% cos 21 + 82 sin 2r — 816! + «1.οἱ + her! 


9. y = te~74 + ρθε. yo(Nfe—¢-2 ~ (¢ — Ie 2-2] 


tet + oe 2t ft < 2 
te—7? 4 e—2t 4 e-(t—2) _ (ει. — 1)e-2-2) δὲ» 


11. y 
13. y 


2 sin 2t + Be—-*) — Set-* 
1 — 2te-' — 2 (01 — te~¢-] + uo) — (t — 1)6-ἰ(--2)) 


1 -- 2106" ift < 1, 
—1 — 2te~' + 2te—“-Y) {1 < , < 2, 
—2te—* + 2te—¢-D — (t — De"? if2 <1 


00 k 
17. Jo(t) = > (—1) μβι 


£4 22k(k!)2 
Section 5-7 
t ᾿ 
1. f ft — £)siné dé a ὁ Ὡς Pe 
O 
bt at 
oF 3[t cos ¢ + sin #] 7. ---- ἴα τέ b; te’ ifa = b 
9. τς πες (cos bt — cosat) ifa” #6; frsinat ifb = +a 
tier τι d eves 
: ΐ -- oo 
ef” ΚΙ — Bee) de Cae 
τ -1δ 3π 1 9 48 
21. 2 tan ᾿ 23. > = 5 Sin ( + 5) 3 tan 3 


27. The minimum is between x = 1 andx = 2. 


31. (a) Vr (0) 2 
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Section 5-8 

1. Κα, ὃ) = ( — Her0 

3. K(t, £) = ge—3® sin 2(t — &) 

5. Κι») = @ — seb 


1. Kit, ὃ) = alex? _ ο([-ϑ.2 cos YS ( ~ 4 369} sin 3 ( 7 Ἵ 


9. K(t, £) = V2 fe V0 sin V2 Spy cos 2 ( -- 9] 
+ e807) sin V2 — ὃ -- cos ¥ - | 


ll. y = μι()  -- t+ Be’! — οι YY} 
_ jo fOCt <1, 
1—¢+ $e“! —e“-)] ift > 1 


17. y = de“) — Aelt-n/2 — 6 sin t — τ cost 
19. y= Bet(t—2) + Ze (t—2) + se + pret! 10 = tte 


21. y = e/*[ A(t — a) sin 3¢ — 75 sin 3a sin 3({ — a)] 
+ e-2/217 cos 3(t — a) — 4 sin 3(¢ — a)] 


23.y =t—a— 8 310 (ἡ — a) + $(¢ — a)cos(t — a) 


Section 5-9 : 
3.y = ξε΄ +4e°H+ 20/3 6? sig VE 
+ u,(t) jae - ico cos ¥ ( —1)+ EP sin YS ( — | 
yj 2 , | | 
de + deh + Be fO srt sl, 
bt ne ΞΡ Ξ = 
de’ + de! + 2013 61 sin VS + fe OP 46 Y? cog 3% — 1) 


+ EF oa Si v3 


ας @ — 1) ift> 1 


4 sin 2¢ + ἐμ, (012 cos t — sin 2η 


4sin2¢ if0 S$ ¢ S 7/2, 


= 
< 
I 


4 sin 21 + 4cost — $sin2¢ ift > /2 


ἀπο γον πε ay = aces ΑΕ 1 ΔΆ μαα |E 
3 m k m 


13. @) y = ε΄(-Φ + 86:80) 
(b) 1 = £1n3 = 0.27465 
(c) V/3/27 = 0.064150 above position of equilibrium 


ee -ἰ -:--.--..ὃὦ 
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(d) Mass starts at time t = 0 at the point 1 unit below the position of equilibrium 
with velocity 10, and moves upward. It passes through the position of equi- 
librium at t = 4 In 3, and at t = 4 In 3 it reaches its maximum height, ν. 37,27, 
above the position of equilibrium, after which it descends asymptotically 
toward the position of equilibrium. 


15. y = ο΄ "fa + (6 + aa)t] 
a / — Ἃ2 a/ mee 
17. y = ων πὰς NR NE 4. 2bm + λα V 4k — de? | — ἢ. 
2m V4km — 2 2m 
Chapter 6 
Section 6-1 


5. (b) No; if f(x) = 0 on (0, ©) except possibly on a finite closed interval, then the 
equation cannot have infinitely many solutions on (0, ©). 


Section 6-2 
7. (a) κ΄ + (: + oe 8 = 0, on (—~, 0) and (0, ~) 
» , 1+ ppt D0 — x’) 
(b) μ΄ + , awe ὁ" = 0, on(—, —1), (—1, 1) or (1, ©) 


(c) uw” += πο ed Pet = 0, on(—©, —1), (—1, 1) or (4, ©) 


(d) κ΄ + Ωρ + 1 — xu = 0, on(—%, ~) 


Section 6-3 


1. (a) — 4 — xX τ an 6y - 0, on (—o, —1), (=I, 1) or (1, 2 ) 


(b) 4“ "ὦ 2) 4 (1 -- 4) ey = 0, on(—~, ΟἹ) 


© Zlat - ay" ᾿Ξ 3(x* — 2. ἦν = 0, on(—~, —2”"), 
(ar. 2.15) or QO. 2 ) 
d 3/2 dy (—In x)? sin x 
ΠΕΣ In x) 4 + Ix y, On (0, 1), 
1/2 
ΠΩΣ 3/2 a) din x) '~ sin x πὸ 289 
d. 2X | 
2x 
‘Sis 0, -- --Ἰ 1, 2 
galeeal* T@+ ip?” a a ἃ, 
δ (δ — py = 0, on(—~, 0) or (0, ©) 


ὩΣ 
5. (a) Every solution has infinitely many zeros on every interval of the form (— οὐ, —a) 
or (a, ©), where a > 1, and does not oscillate on (—1, 0) or (0, 1). 
(Ὁ) Every solution has infinitely many zeros on every interval of the form (— ©, a) 
and does not oscillate on (1, ©). 
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(c) Every solution has infinitely many zeros on every interval of the form (a, ~), 
where a > 1, but does not oscillate on (— ©, 0) or (0, 1). 


7. (a) Every solution has infinitely many zeros on every interval of the form (a, ©), 
where a > 0, but does not oscillate on (— οὐ, 0). 


Section 6-5 


A. y = aoyo + ays Yo = Dy aap 
44 (2k)! 


ee (ΠΡ eg 
n=) aoe , on (—%, οο) 


3. y = aoyo + a1y¥13 yo = 1 + ----------.-.-.-Ἕ.Ψ.Ἕ.ἙΨἙ.ἙἍἙ- χ 
2 ke 5-8 Gk Τὴ 


k 
MTT, on (—2, &) 


pass Loa CRED 


_ 3 Ξ (—1)" 2k 
5. y = a(x +x) + 300) Ok = NRK =D “OES * ORLY 


7. y = a(x + $x’) 


+ ao [ τὸ πε 3 > (yt GET VEE τὺ Dl, 
k=3 


on _ v2 v2 
) 
9 y = + h Poy at ty 
- Y = 4oyo + aiyi, where yo = q Ki x , 
k= 
20 Lop yr 
y= δες ἐὺ SE οὐ ar me 


"Ὁ 1.(4(Ἠ31)4 + 3:2}... ((ἅᾳἩᾳ + 3k) 


i? 8] 


of ED οἡ 1 Δ)» πτιχϑεν ! 2 yk ἘἘὶ 


Li 1 k—1_2k 
ak -=) —.— 7) x san 
δ κοῖς " ᾿ 


13. y = aoyo + aiyi + aeye, where 
“.1:10-19- 9k — 
yo = 1 ae > | 8) x, 


μὰ 
μ-ι 

<= 

| 
| "πὸ 


Gk 


2. 4-13-22:-+(9k — 5) kth 
(7 Sok) τς  ὐτ 
2d eran 1)! 


Pe ty peace ες 2) 3k+2 


δ (Gk + 2)! ΟΣ ar Has 


15. 


17. 


19. 


21: 


23. 


25. 


v1 
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y = ἀργὸ + a1y1, where 
yo= lt 
>, 274-1) — 1G) — 12) — ++ -τὰ — τ)ί — 2) — 1 ϑ3ι 
k=l (2k)! oe 
= x + 
> f= D = 416)6) -- 416)0) — 41 + -1@k -- Ik — 3) -- 4] κει 
k=l (2k + i 
on (—1, 1) 
Y = »» + aoyo + a1yi, where 


Sn as ee cna, Pe ἐν et We ees 0 
» Ξ gx Tex + yosx + Gox — εἰσοχ 


Lv Gk -- TIQK + Τ)ῶκ + 3) 2k 
Ξ 240-DKk — 4)! ᾿ 


= π᾿ 175 x! 105 6 | 5 Sy (2k — 7T)'2k + 1)2k + 3) x 


POSE ee og 004 γε ποκα... 4!’ 
yi - χ -- χ' + 4x’, on (—2, 2) 
"- etl &k et ce ae 1 1/3 41/3 
y= ad (- 1) 23k — 1) ne * 4 ayx,on(—2/°, 2°") 
y= i + ae + age + >> aopx” + 3 Ak a where 
2 6 24 4: ae 
a2, = pil — 2k — 2) + 2°(k — 2)(k — 3) - 2°(k — 2)(k — 3)(k - 4) 
tes + (-2)°% = 2), 
1 
Q%41 = Ge pi! — (2k — 3) + (2k — 3)(2k — 5) — (2k — 3) Κ — 5) 
X (Qk — 7) +++ + (Ὁ Uk -- 3)2k — 5)(2k — 1)--- ΑἹ, 
on (--οο, ©) 
There exists a solution which is a polynomial of degree zero (a nonzero constant) 


if and only if Y = 0; there exists a polynomial of degree 1 which is a solution if 
and only if 8 + Y = 0; there exists a solution which is a polynomial of degree 
n > 2if and only if n(n — 1) + Bn + Y = 0 and eithera = 0 ογ k(K — 1) + 
Bk + Y τέ 0 for all nonnegative integers k which are less than 7 and differ from 
n by an even integer. 


(b) A basis is {yo, y1} where 
= τ rDNA -- DA -- 4)- - -ΙᾺ -- 2( -- DI eh 
Yo = 1 + Σ, (—1) a πεν, 
7 .2Ὁ — DOA — 3 — 5)... - Ck = DI 3 κει 
yi= x + 2d (2k + 1)! x 9 


on (--ο, οο) 
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Section 6-6 
1. y = 1 — ἐχϑ + poor? + γτέσοχϑ + +--+, on (—~, ~) 
3.) = ~1— x + fx? — dx? - τ, on (-- 1, 1) 
τ πὶ, at Ὁ ae 
7. y = 6x + 4x2 4+ xt 4+ 5 sox? +: --, on (—3, 3) 
9. Ψ ΞΞ 3(x ae 3)? + Zo(x 35 wer sag = 3)6 ἮΝ 55 (x a 3)? + yee yon (0, 6) 
11. y = gx? + -ἀχθ + At + ahr? τ, on (- 2%, &) 
13. x — $x? + τχῦ — ax? +--+, on (—%, &) 
Chapter 7 
Section 7-1 
1. (a) —5 (b) 4+ (c) 0 (d) —10 (e) 2 
3.@0 Ο ξ5- ἡ ©3-e (d) 0 ( Ξ 
4 7? + 4 
5. (b) 
9. (a) No; f-f = Ο does not imply f(x) = 0 on [a, 6]. 
(Ὁ) Yes; Definition 7-1 applies. (Note. If [P(x)]* = 0 on [a1, 1], then 
P(x) = 0 on [a, 6]. 
11. (b)a > 0 
Section 7-2 
5 se 
1. (a) 3 (b) ἃ (c) ν 35 (d):-——— (e) V 39 
V3 > i Ν 
3. (a) 37 (Ὁ) Ve — 1 C= (d) > (e) V2(1 — In 2) 
5. (a) (i) 0 vn ὦ V3/2 
(ii) 0 (ii) 15/4 
(iii) —4 (iii) 4 
7. (a) @ π, ifm = n σέ 0; 0 otherwise 
(ii) 0 
(11) 2rifm =n=O0;rifm =n ~ 0:0 τἴ γι ¥ ἡ. 
(b) Orthogonal, that is, the cosine of the angle between any two distinct vectors 
(functions) is zero. 
Section 7-3 


«ἊΣ V6 B10) is 


5. 2 2 8 


7. A(x? -- 2x), A any nonzero constant 


V6 


9, + ~~ (1,0, ~1, 2) 11. ae™ — ; (e2 — 1)e-*, a arbitrary 
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Section 7-4 


1. 


15. 
17. 


. (a) οἴ, 6 — 


Ὲ (a) a; = 


(a) (1, 1, 0), (—1, 1, 0), (0, 0, 1) 

(b) (3, 0, 2), 4(—20, 51,5), 33% (12, 5, —3) 
(c) (2, -1,1), 4, -—11, -19, 4&6, 7, -- 3) 
(ὦ (1,2, —1), 4(13, 2,17), 33(--6, 5, 4) 

(e) (1,0, 0), (0,1, 0), (0, 0, 1) 


. (a) (i, 0, 0, 1), (=i, 0, 2, 1), 3(2, 3, 2 —2), 2(-1, 7. =; 1) 


(b) 3(4, 0, 1, == 2), si (—4, 0, 62, 23), φρο, 0, —4, 12), (0, l, 0, 0) 
(c) (1,0, 0,0), (0, 1,0, 0), (0,0, 1,0), (0, 0, 0, 1) 
2 2(e? +e + 1) 
x b ᾿ 2. x 
e2— 1° Pree 3e+1) 
(c) 1, 2x ~— 1, οἴ + 6(e — 3)x + 10 — 4e 


. 1, hes 


n 


Xe; _ vr & edly: es) 
ore FA 123.-50 Ο)χ 2 ἘΞ Ε 


1 
. & —— (4, --Ι, 2) 
ν 21 


(Ὁ) (4, 1, 1) 
(a) Po(x) = 1, Pilx) = x, Pax) = 863 -- ἢ 

Ps(x) = $03 — 3x), Pala) = 3804 — $x? + Ὁ 
(Ὁ) (i) 2Po(x) — 2Pi(x~) + 2Po(x), 

(ii) ~2P3(x) + 6P2(x) — 6Pi(x) + Pot), 

(iii) 3P3(x) + 3P2(x) + $Po(x) 


Section 7-5 
“2 30V/ 29 
1. (Ὁ) > (Ὁ) 2 (c) 35 (d) 
2 29 
V/ 43 
3. (a) 1 (b) “2 (c) τὴν. 1785 (d) 3 
5. The line spanned by (4, 3) and that spanned by (3, —4) 
7. (a) 4V3 (Ὁ) τὸν 497 (c) 1 
9. Οὗ, ὅν Ὁ 
11. (a) Projection, 2 sin x; [[4} = rv 6/3 


13. 
15. 
17. 


19. 


(b) Projection, 4 + 4 cos 2x; ||d|| = 0 
(c) Projection, 4° — 4cos x + cos 2x; [ἃ = ἴεν, 5π(8πἪ4 + 2295) 


$s 2 
Qn = 036, = (—1) hs 
n 
ago = lag = —4,an = Oforn ¥ 0,2; δὲ. = O,alln 
ag = T,an = ey — 1], whenn ~ 0;5, = 0 
ππ 


_ ἘΞ (δ ἐΞ 6 


(—1)"t n(e” ΝΕ ο΄ ἢ 
an ve bn Sj — eee 


(n2 + 1)π ᾿ (n2 + 1)r 
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heal); 31 — (-1)"] ISnf1+(-1)'],2— , 


21. Projection, —-————— - 1 - Ὁ "ὦ “- -- i): 
gap ΜΕ, aaa 
2 3(2n” + 2n + 3) ᾿ 3 Εν 
d|| = Cr a = ἘΌΝ οὐ ee 
πὸ», πος ἴδε 
(b) Projection, 3(sin 1 — cos 1)χ; ||d|| = ἔν 22 sin 2 -- 20 
(c) Projection, 4-1 + 15 (χ' — 4); [ld] = a 
(4) Projection, 1 + 3(x” — 4); [4| = 0 
23. If - Ὁ, then X+ contains only 0; if 9C contains only 0, then X+ = Ὁ. 
27. (a) ay + 12, where y and z are linearly independent and orthogonal to (1, 1, 0) 
and a, 8 are arbitrary reals; for example: 
α(, Ξε}; 0) ΓΕ BO, 0, 1) 
(Ὁ) a(1, 1, 0), a an arbitrary real 
(c) ay + 2, where y and z are linearly independent and orthogonal to (1, 2, —1) 
and a, @ are arbitrary reals; for example: 
a(l, 0, 1) ΞΕ B(—2, 1. 0) 
(4) a(l, —1, 0), a an arbitrary real 
Section 7-6 
1. (a) A: 1.4082; B: 1.4136 
(Ὁ) B’s data (Variances 9.056 X 10“ ὃ and 4.744 x 10° for A and B, respectively) 
3. (a) A: 16.06, variance 0.00236; B: 16.12, variance 0.00092; B’s results are the more 
consistent. 
(b) 16.09, variance 0.00254, greater than for either A’s or B’s data alone 
5. (2.25, 2) 
7. (a) (—0.8, 0.4, 1.7) (b) (3.4, —1.3, 3.6) (c) (1.9, 0.4, 0.8) 
9. (Ὁ) my = 1, mo = 5, mg = 3, ma = 1 
13. (a) 54x — 35y = 0 (Ὁ) 417x — 142y = 0 (c) 26x + 17y = 0 
15. y = $x1 + 3xe 17. y = x1 — χὰ 
19. y = 3x1 — ἦχ — fxs 21. (a) y = --ἶχ" + 33x 
(0) y = 33x? — τὸ 
(c) y = -Κἡγ͵χ — 88x 
23. y = —#x* + 18x? —- 3 
Chapter 8 
Section 8-1 . 
1. lim {a,} = 0 3. {αι} does not converge. 
k—0 
5. lim {a;} = 1 7. lim {αι} = 2 
k—r00 k—>y00 
9. lim {x,} = ey + e2 + e3 11. {x,} does not converge. 
ka 
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Section 8-3 
3. With respect to the first set 
᾿ ε --εὖ 
es 
V 2a 
eae 3ὸὲ 
---- ---(6 — 2 ) k= 1,253,456 
4 - Ἡκῦντ 
With respect to the second set 
ὧς = ἐπ Ξε ae fa —e') k = 1,2,3,... 
( + k2)/r 
Section 8-4 
3. 70) = Ξ + DY) (ἃ οος kx + by sin kx), where 
k=1 
1 τ 
ἂς τ - f(x) cos kx dx, ame —tat OU Ree’ Ane, eee 
if" 
b, = = f(x) sin kx dx, | ΞΞ (a? ee νεςς 
Section 8-5 
3. (Ὁ) fe 
13. (Ὁ) The vector y = (71, y2, y3,...) is in S(X) if and only if for some integer 
k > 2, Yeti = Veto = Vets = 5" = Oandy1 = yo + ya tots + Ye 
Chapter 9 
Section 9-2 


1. (a) fa> = 1, ΤῸ = —1; in 6C(0, 2] 
(Ὁ) f(O+) does not exist; not in GC[0, 2] 
(c) f(1-) = 0, ft) = 1; in ΦΟΙΟ, 2] 
(d) fa-) = f(1* = 0; in C[0, 2] and so in PC[0, 2] 
( ΑΕ) = 1, ΚΕ) = ΑΞ) = 0, FE = ἐ; in PC[, 2] 
(Ὁ ΚΙ does not exist; f(1*) = 2; not in C0, 2] 
3. (a) In C[0, 1] and so in GC[0, 1] 
(Ὁ) Not in @C[0, 1] (Infinitely many discontinuities) 
(c) Not in @C[0, 1] (Infinitely many discontinuities) 
7. Yes; a linear combination would vanish identically only if all the coefficients were 
zero. 


Section 9-3 


1. (a) Odd (b) Even (c) Neither (d) Even (e) Odd 
(f) Odd (g) Neither (h) Even (i) Neither (j) Even 
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x +1 2x 
7. @) fe@) = τς τ’ 0) = a τ 
1 x 
(0) ὁ) - στ’ 0).  - a 
(c) μια) = — cos 2x, fo(x) = aid 
x” +1 x? an x 
(d) f(x) = 4 fo(x) = Ἐπ 
᾿ ax” +c 
(©) fal) = a2x4 + (2ac — b2)x2 + c2 
fo(x) = ae 


~ g2x4 + (2ac — b2)x2 + c? 


9. fre(x) = — ἯΙ Σ An COS nx, fo(x) = 5 by SiN nx 


Section 9-4 


11. 


13. 


15. ( 


17. 


1 1 [ἢ a 1 n 2 og π|. 
ΤΕΣ sinheosme ας 1) τς 955 Σ sin’ sin ns} 


5 5 
(a) On 25 =) and (= : sr) the series converges to —1 and 1, respectively; 
at x = 5π|2 and x = 3m the series converges to zero. On [—2z, —37/2) the 
series converges to 1, on (—32/2, —7/2) to —1, and on (—7/2,0] to 1. At 
x = —3nr/2 and x = —7/2 the series converges to zero. 


(Ὁ) When x = kz, the series converges to +1, according as k is even or odd; 
when x = (2k + 1)m/2, the series converges to zero. 


(Ὁ) When x = kz, the series converges to 7/3; when x = (4k + 1) 7/3 the series 
converges to 7/6 or 7/3, according as k is or is not an integral multiple of 3. 


k+1 
ΣΕ (Qa 1) τέρα + ἘΠ sin kx) 


k+1 
(a) coSax = Sinan + 2a ba eer ae cos kx| 
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19. (a) Periodic; fundamental period 8 (Ὁ) Periodic; fundamental period 27 
(c) Not periodic (d) Periodic; fundamental period 27 
(e) Not periodic (f) Not periodic 
(g) Periodic, every rational number a period; no fundamental period 
2 < sin (2k — 1)x π ~~ sin 2kx 
23. — — — τ - - 
a) =e 2k —1 (0) 5 2, k 
ΠῚ 2 δ. sin kx 
k 
k=1 
25. (a) $ — 4.cos 2x (Ὁ) 3 sin 2x 
(Ὁ #sinx — 4 sin 3x (d) 4sinx + sin 2x 
(ὁ) cos x + 4cos 5x (Ὁ 2+ $cos2x + $cos 4x 
27. Let f(x) ~ ᾿ + » (a, cos kx + b, sin kx); then 
k=1 
(a) f(-x)~ -- ea > (a, coskx — 6b, sin kx); 
ao = : 
(b) fax) ~ > + du a, cos kx, fo(x) ~ Σ by, sin kx. 
(c) 1, cos x, cos 2x,... and sin x, sin 2x, ... are bases for &[—7, π] and O[—z7, 7], 
respectively. 
Section 9-5 
1. @) E = 1, - (ii) Ey = x*, -π <x <, 
O ey O ~—x*,-r <x <0 
; 1.0 «χ τ : x270<x<t 
sag _ Ja+x—m<sx <0, _ je*—m <x < 0, 
ἘΠῚ πὸ OEE i θὲς αὶ 
ΓΞ -π-- χ,--ππ < x < 0, 0, = —e*,—-7r < x < 0, 
: w—-x,0<x<f : e,O0<x<t 
8 ~ k . 2 = k k+1 α 
evga ἪὉ Ty ell + 1)" e]sin kx 
Dee Ds rsin kx 
k=1 
9 4 apap cH - =a sin (2k — 1)x 
: ot (2k — 1)? m(2k — 1) 
4 . 
4 f(x) cos kx dx WKS 13.5.2 2 
11. 4, ee 
0 ifk = 0,2,4,6,... 
13. —cos x 
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Section 9-6 
1 οὐ 
3. f(x) = 4 ee Ay cos 5" » where 

2 4 : 

kn ken ifk = 1,5,9,..., 
pele ifk = 2,6, 10 

A, = k2q2 i, aa go ὁ, pee ey 
2 4 
πὰ - Wk = 3. ΤΊΣ κα 


0 ifk = 4,8,12,16,. 


2 4A< 1 : π 
5. τ = Sa eo O0O<x< 2 


ἘΣ {5 0 a k sh Ns ΝΣ 8<x < 10 
key? COS KITX πον ΠΤ ; x 


9, -- 2 ΟΣ sinknx, 1 <x «2 
k=1 


16 <5 ((—1)' 13" 2 _ (2k — 1)πχ 
un. By (GP - (Qk — 13 sim 2 pb SX SS 


13. - δ ἔρίη ἀκ, rx <a 


Section 9-8 
1. (Ὁ) [A@)e;0)|] = AGA llesOIl | 
3. If F(—x, y) = F(x, y) and F(x, —y) = F(x, y), then 


co 
F(x, y) = > Apq COS PX COS Gy. 
p.q=0 


If F(—x, y) = —F(x, y) and F(x, —y) = —F(, y), then 


foe] 
F(x, y) = De Amn Sin mx sin ny, 


mn=1 
1 m+1 
5. 2 ye (- 2 ——_———. sin mx 
mas] 
4 + 4cos 2x cos 2y — 4 sin 2x sin 2y 


εὖ es | mt+q+l 
2π᾿ τυ. Ὁ sin mx + 8 > (τ sin mx cos ay 


m=] m,q=1i 
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Chapter 10 


Section 10-3 
= 2) bi/k; ἀκ = —bi/k, k #0; Be = ark 


5. (a) |f(x1) — f(xe)| < M\x1 — xe|*, where 
(i) M>0,a> 0; Gi) M> 1,a = 1; Git) M> 2,a = 1; 
(iv) M > 2π,α = 1; (V) M > 3n’,a = 1. 
(c) Only constant functions satisfy such a condition. 


Section 10-6 
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3. No; the formula x/2 = Σ᾿ 41 [Ξ- Ὁ (sin kx/k) is invalid outside (—7, 7). 


Section 10-7 


1. With obvious conventions it is a vector space. 
3. (a) 0 (b) 0 


Chapter 11 


Section 11-2 


1. Pi(x) = x; Po(x) = 3x? -- Ee ese = ca — 3x; 
P4(x) = 33x+ -- 42x 2 + 2; Ps5(x) = — 35y3 + 18 χ 


Section I 1-3 


1. Pa(x) = gx° — 9%; io = δ χ -- τῷχϑ Ὁ ὃ 
3. Pg(x) = 23156 = 315 y 44 1082 _ 5 


Section 11-4 
1. If f(x) is an even function in @C[—1, 1] then 


f(x) = Σ᾽ a2ePox(x) (mean), 
k=0 
where ao, = (4k + 1) (( f()Pax(x) dx. 
If f(x) is an odd function in @C[—1, 1], then 


70) = Σ᾽ aen41Pon41(x) (mean), 


k=0 


where dox41 = (4k + 3) fo f(x) Pon41(x) dx. 


Mises epee Εν 


Rk — Dk + Di tO =f=<> <1 


5. (a) 2Pi@y) + gP 3) 
(b) pO): aeP1(x) + 35:30) + 3 Ἐφ 5(x) 
(c) #2Po0(x) — P(x) + Z8Po(x) + 3 33 P4(x) 
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Section 11-5 


1 1/2 1/2} [1 
1/2 _ 2 2n + | | 
lin ! »(Χ)Ρ, (ΧῚ Ἢ ΞΞ (» mb :) ( γα -' g(x)P,,(x) dx 
Section 11-6 
1. All the functions belong to 9%, except those in (a) and (g). 
7. (Ὁ) He(x) = χῦ — 15x* + 45x? — 15, 
H7(x) = x? — 21x5 + 105x? — 105x 
Section 11-7 
9. (Ὁ) Lo” = 1, LS? = x? = 85χ- 12, 
Le ae 3: 11 = x® — 15x” + 60x — 60 


Chapter 12 


Section 12-1 
1. y = cosx + csinx 3. No solutions 
5. y = ccos 3x 7. No solutions 


9. Xn = n?,n = 0,1,2,...5 yn = οι COS MX + co SiN nx 
3 


Section 12-2 


1. Ὃ and the trivial subspace 


Section 12-3 


1. Using standard basis 61, e2: 
(a) ἃ = 1, with eigenvectors of form x,e1; 
λ = 2, with eigenvectors of form x,(e1 + 69) 
(b) ἃ = 0, with eigenvectors of form x2e9; 
λ = 1, with eigenvectors of form xe; 
(c) A = 0, with eigenvectors of form x;(e1 — 69); 
A = 2, with eigenvectors of form x;(e1 + e2) 
(d) A = 3, with eigenvectors of form x2(2e; + e2); 
A = —1, with eigenvectors of form x2(—2e, + e2) 


3. Using standard basis 61, e2, e3: 

(a) ἃ = 0, with eigenvectors of form x;(e1 — e3); 
λ = 1, with eigenvectors of form x2e2; 
\ = 2, with eigenvectors of form x;(e1 + e3) 

(b) A = 2, with eigenvectors of form x2e9; 
h = V2, with eigenvectors of form xi(e1 + [2 — 1]es); 
\ = —v2, with eigenvectors of form xi(e1 — [1 + V2]e3) 

(c) ἃ = 1, with eigenvectors of the form x2(—3e1 + e2 — 3e3); 
λ = 2, with eigenvectors of the form x2(2e1; + 69) + x3(2e1 + 65) 
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(d) ἃ = 0, with eigenvectors of the form x3(3e1 — 2e2 + 63); 
5+ ν΄ V5 -- 1 
A = 5: 55 , With eigenvectors of the form x2 (c: + e2+ τ 43]; 
5 -- V5 1- V5 
ΝΞ ΤΡ ἢ with eigenvectors of the form x2 (c 1+ e2 - Te es) 
5. (a) x = —#e1 + e2 + Ses (b) x = ἔοι + Jes 
(c) x = —Se1 — 2e2 + 4’es 


9. (b) ἃ = Ο is an eigenvalue of multiplicity n + 1. 
So is the subspace of constant functions; dim 80 = 1. 
Section 12-4 
1. (a) λι = tle +at+Vc — a)? + 467], 
ho = He +a — Ve — a)? + 462] 
(b) [ce ~ a+ V(c — a)? + 462 ]e1 — 2665, 
—2be; + [ce — a — V(e — a)? + 462 Jeo 


[Note. If b = 0, one of these vectors is the zero vector; in this case the required 
basis is {61, e2}.] 


3. = n*,n = 0,1, 2,... 
5. (Ὁ) The null space is the set of all functions F(k) in § of the form 


F(k) = cik + co, k = 0, +1, 42,..., 
where c, and c2 are arbitrary real constants. 


Section 12-5 


3.\ = n?,n = 0,1, 2, 3,..., with eigenfunctions of the form 
y =ccosnx (c ¥ 0), 
(2n + 1)? hea 
A = ee ee 0, 1, 2, 3,... with eigenfunctions of the form 
2n 1)x 
y= ¢ sin EO (c ¥ 0) 
Section 12-7 
128 ἐξ 1 . 2.-Ὁ 1 2 
- Ξ---- re Te a a i bd = =o 0 
l. y - Σ, Gn τ ἢ sin ee 3. No solution; λο = 0, co ra ψέ 
 [ (-- ΠΡ} }}4 1 E + aad 
pays — τς -  -- --- - -- “ “- | sin 2k 
5. y Σ De τὰ -ἰαβ sin (2k — 1)x + TE sin 2kx 


7. If f2" h(x) dx ~ 0, there is no solution; if (2" h(x) dx = 0, then 


οο 
y=c+t+ ) An CoS NX + by sin nx, 


n=l 


where 


2a 2π 
ὯΝ Ξ = | h(x) cos nx dx, bn = ᾿ | h(x) sin nx dx, 
rJo wJo 


and c is arbitrary. 
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Section 12-8 
1. An = n? — 1, ¢n(x) = Sin nx,n = 1, 2,3,...; orthogonal in C[0, 7] 
3. Xn = —n?r?, on(x) = e-* sin mmx, n = 1,2,3,... 5 orthogonal in C[0, 1] with 
respect to the weight function e2* 


_ ATX 
ev sin >, n = 2,4,6,..., 
5. \n = n*r?, o,(x) = 
«2 ἀλμδοὶ = 1.3.5 : 
ev!" COS, ἢ ee Sen Me 


orthogonal in C[—1, 1] with respect to the weight function e~* 


7. Xn = —n?, n(x) = e7*(ncosnx + sinnx),n = 1,2,3,...,andd = 1, φ(ὴ = 1; 
orthogonal in @[0, 7] with respect to the weight function e2* 

9. Here the set S of eigenvalues is not a sequence but a region of the complex plane, 
comprising those points ἃ = & + in such that —1 < & and [n| < 2(€ + 1)!/2, 
with the addition of one boundary point, \ = —1. To obtain the eigenfunction 
y(\; x) corresponding toa given ~ 0 οἵ S,set\ = pe (where p = [£2 + n2]1/2, 
£ = pcos 0,7 = p sin 0,0 S @ < 2m) and let a + i8 = p!/2e!—-*)/2, so that 
a + i8 = (—))!/?; then on0 < x, 
φίλ; x) = x!t[cos (6 In x) + isin (β In x)] — x!~[cos (8 In x) — isin (6 In x)]; 
also, o(0, x) = x In x, 0 < x. 


Section 12-9 
1. (a) One-to-one (b) Not one-to-one (c) One-to-one 
(d) One-to-one (e) Not one-to-one 


_ [8+ DG- 2, χξε 
7. K@,) = A(x — Wert), x>t. 


Section 12-10 


- (cot k sin kt — cos kf) sinkx, x <1, 


μ᾿ Ὁ} μὰ 


3, (a) Κα, ὃ = 
1 (cot k βίη kx — cos Κχ) sinkt, x >t 


[Note. The constant k may be chosen as any real number except that k must 
not be an integral multiple of 7, since then L = D? + k? is not one-to-one 
when restricted to 8.] 


(Ὁ) yx) = ; {(cot k sin kx — cos kx) A(t) sin kt dt 


1 
4 (sin kx) [ π(ϑίοοι k sin kt — cos kt) dt} 


Chapter 13 


Section 13-2 
1. (a) a(x, y, 2). + bx, y, z)Dy + c(x, y, Dz + d(x, y, 2) 
(b) a(x, y)Drz + b(x, y) Day + c(x, y)Dyy + d(x, y)Dz + e(x, y)Dy + FO, y) 
Section 13-4 


1. u(x, t) = cos oe sin ene 
᾿ 1, L 
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ar? 2 1 41 nrat . μπχ 
3. u(x,t) = lu all + (—1) ] cos —— sin | — 
ἫΝ 
nrat L nrat\ . Μπχ 
5. u(x,t) = y (4. cos —— ἘΞ: περ ἐν sin τ mat) μη πτς 
7. u(x,t) = Ley F gig τ cos sin = 
RN, ogee n 2 L L 


4dr 1]. 1 . at 1 at\| .. mrx 
_ ἜΣ ΓΤ Ἢ 4) + sin ππ (5 -- Δ sin πτΣ 


When ¢ = L/(2a) or t = 3L/(2a), the string is in the position of equilibrium 
(y = 0); when ¢ = L/a, it is ina position which is the reflection in the x-axis of 
its initial position; when ¢ = 2L/a, its position is identical with its initial position. 


21, «ΑἹ nv. μπδ. μππαΐί. ππχ 
9. (a) u(x, y) = ΡΣ 


ae sin — sin = sin ----- Si --- 
πϑβαρὸ τ Σ 2 1, L L 


οο 
nr nrat . NTX 


2 1, 
(b) fn u(x, y) = rap 4 “ΝΣ a sin — 5 sin a sin oT 


The vibration “πὸ τ in (Ὁ) may be interpreted as that approximated by a 
string when it is given a sharp blow at the point x = L/2. 


οΌ t 
11. @ φα, ἢ = >) (c, cos Ἴτ"- + D, sin raat) sin > 


n=1 


where 
2 . NX 2 . NX 
CO. = ZL ; f(x) sin Ἴ dx, Dn = SF J g(x) sin ὙΓῊ dx 
ris = nrat _ μπαΐ nx 
(Ὁ) φᾷ, ἡ (49 + Bot) + Xu (4, COS ἽἼ + 8, sin Ἴ co: L 
where ss 
A was fx) cos =~ dx n= 0,1,2 
τ Ι, 0 Ι, 9 = 9 Ao Hoe ce 
L L 
2 
Bo = ΣῚ g(x) dx, B, = — g(x) cos NS ἄν, n= ip 2. 
L Jo nia Jo L 
= (2n — 1)xat 


(c) g(x, ἢ = > = cos 57, 


(2n -- εἷς as (Qn — 1)nx 


+ Bon—1 sin — 57. 57, 


where 


Aon—-1 = id f(x ἀπ 5. 


δὰ g(x) sin (on τ Σ dx 


Gn — Un dx 


3 


Ban = (2n — “Te 


Section 13-6 
1. u(x, t) — 4L —[(2m+41)? x? t/ L207] ein ot Lex 


πὸ 2, Om + Ὁ" L 
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81 Υ 1 go ἰ(2πι-Ε1)5 t/L?.a2 | ΓᾺ (2m + 1)rx 
πϑ =, (2m + 1} L 


2k = 1 Be ee ray Pr: 2mrx 
5. ost) = lh 2 ge : ans cos ZL 


3. u(x,t) = 


Ag = EXgeuteip ene μππχ 
7. u(x, 1) ae oe > Ane ἀμ; *” 008 "τ 
n==1 


where ἦ 
2 Ἠπχ 
Gr ῸΣ sore 9 a es ye 08 
A Lie f(x) cos Τ dx, n=0 3 
" x 200 = 1 —~—(n2x* t/L2a2) .  NWX 
2. w= 100(1 2) + - Qu ane 1° sin τ 


(—1)" —(n?x2 t/a2L2) . AMX _ x 
re sin "τ (b) u(x,t) = r 


2 ὍΟ 
11. (a) wat) =F +20 
n==1 


2 - _ aig — 10 —(n*r a ; 
13. u(x, = ee ye το (n2n? t/L2 πὰς ΠΕΣ 
᾿ 1 


L ce n 
Section 13-7 
2 wo —[{(2k4+1)24? t]/(a2 Μ32) 
— (8M (92) (0222) WX e . (2k + 1)ry 
3. u(x, y, 1) = (™ e cos 7 » Ok + 18 sin ag 
oO 
5. (a) u(x, ν, 2) =D) @ma(tanh πιὰ μι + 1? cosh m2 + n? z 
m=1 
n=] 
— sinh~/ m? + πῶ z) sin mx sin ny 
where : 
4 ᾿ ᾿ 
in = | / F(x, y) sin mx sin ny dx dy 
a2 tanh πὶ m2 + n2/0 40 


(b) Let u;(x, y, 2), vi(x, y, Z), i = 1, 2, 3, be solutions corresponding respectively to 
the boundary value 0 on all but a single face, on which they have the values 
indicated. 
μι(χ, y, 0) = fix, y), κοί, y, 2) = fol, 2), us(x, 0, 2) = fax, 2); 

vi(x, y, 7) = g1(%, y), volt, y, Z) = gly, 2). U3(x, 7, z) = g3(x, 2). 
Then μι is the u of part (a), with f(x, y) replaced by /1(x, y) and 


oo 
vi = ) Finn sinh vV/ m2 + n2 z sin mx sin ny, 
m=l1 


n==1 
where 
4 , ; 
ἔμ. - τ------- -.--- gi(x, y) sin mx sin ny dx dy. 
x2 sinh r\/ m2 + n2/0 /0 


The formulas for u2, uz are obtained from that for μι by permuting cyclically 
the subscripts 1, 2, 3 and the variables x, y, z. Similarly the formulas for va, v3 
are obtained from that for v;. The solution of the given boundary-value prob- 
lem 15 uw = μι + μὸ + ug + v1 + Ve + Uz. 
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ao 
7. u(x, y,t) = »" (Emn COS αν m2 + n2t + Fin 51π αν m2 + n2 Ὁ) sin mx sin ny, 
=1 
wal 
where 


| νὰ ΞΞ = | / F(x, y) sin mx sin ny dx dy, 
Te JO J0 


τ τ 
4 | | | 
Enxn = ----Ξ-ΞΞ-.---Ξ- g(x, y) sin mx sin ny dx dy 
πόαν, m2 +- n2 0 0 


Section 13-9 
1. The formal solution is 


L 
fo ¢] 
(nee? 2,2) . Μπχ 2 _ ἤπχ 
u(x, t) = > Bre ™ PLEO gin ae where B, = 2. f(x) sin —— dx. 
n=l 0 


Chapter 14 


Section 14-2 


1. u(x, y) = > Gy. sinh (μι + 1)πτ(Μ — y) + sinh Gn + Ur sin (2m + 1)πχ 5 
m=0 L L L 
where 

2 
es 16L 


~ Qm + 123 sinh[Qm + 1)1M/T} 


“ ᾿ Μ -- ; 
3. u(x, y) = > Cy sinh mo + sinh = sin τος 
n=l 


L 
where 
<= saab +4[-0" τω] 
~~ 78x3 sinh (nm M/L) \" 2 ΨΩ 
Ce {sinh (7x/M) + sinh [πὶ — x)/M)} sin Gry/M) 
Reece sinh (πὶ Μὴ 
+- Xu Cu sinh OM EOD) a ὑπ =) + sinh aes ay + De 
wigs (2m + 1)πχ 
L 
where 
2 
C, = 8L 


~ Qm + 1x3 sinh (2m + 1)rM/L] 


a - sinh πίπ — y) cos nx 
7. u(x, y) = 5 —y)+ a 
n=! 


sinh nar 


where 


an = 2 | F(x) cos nx dx 
TJO 
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9. wis) = OD πε 1 cosh Om + θεν. μοι Ot + Dey 
weer ‘Cin + 1)rx 


Section 14-3 
Inr — In Rj 
3, u(r) = Re τ Re μᾷῳ Ri Re ) = 


5. It is sufficient that f(@) belong to ®C[—7, x]. On each subinterval of continuity 
apply Theorem I-15 to the functions f(@) cos n(s — 0), Theorem I-24 to the series 


oO 


Σ᾽. 1" f(0) cos n(s — 8), 


n=1 
Theorem I-22 to the sequence of partial sums, and combine the results for the 
subintervals. 


Section 14-4 


7. u(r, ¢) 


00 
ΣΤ. 
n=O 


where 


ΓΞ: 


if" 
mu [ f(¢)Pn(cos ¢) sin ¢ de 


9. (a) u(r, y) = 4 + r?(cos? yg — ἢ 
(Ὁ) u(r, vg) = -ἰ — 3,2. + 2r? cos* 
(c) u(r,g) = 3 + Br? — 2r* cos? 9 
(ὦ u(r, φὴ = 3& + Ar2(1 — 3cos?y) + (3 — 30cos?y + 35 cos* φ) 


11. u(r, ¢) = Sy Bur” ** Pox. 4.1(cos φ), 
k=0 


where 


w/2 
Βι = Gk + 3)[" f(y)P2r41(cos ¢) sin » ἀρ 


aes γ — - 2 2 


1. (a) R = ie +colnr) if\ = --2; 
γ᾿ "(οι cos [ἅν -Ξ  - 4) Inr + ce sin [2ν -- αὶ + 4λ}} Inn) 
λς-« —i 
3. 400 = 1 Wig = COS¢ “411 = cos @ sin g 
Ui1 = sn@sing μ20 = $cos*y — ἐ u21 = 3cosésingcosy 
uo2 = 3 (05 26 sin? y vo1 = 3 ane aioe ve2 = 3 sin 26 sin? » 


Section 14-6 


2 2 1 1 1 1 4k + 1 
3. Heda a ττ- δε > — αεττ τ τος 
COS ¢ COS θ 00 + 3 420 + 54 u22 + | 4 kk Τὴ ke 1) U2k,2 
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ἢ : (—1)'(4k + 1) 
5. (a) fle8)~ μον + Dy rer aKe — Te + ΤῊ 


x | ce 20 μαι — (2k — 22K? + ke + 2uan2| 


1 = (—1)*(4k - τ). 
(b) μίγ, φ, 8) = 3400 + Di einai — Dk + ΠΡ 


τ E +2)! 


5 2k,0 — (2k -- 22k? +k + 2a. 


7. (a) u(r, φ, θ) ΞΞ > [γ΄ = ὰ τ τ) ΕΣ + Da Avie + Bats ᾽ 


m=0 n=l 
where 
= Ου ες δὶ | 
Amn = Amn(a, δ᾽ 8) = jamti — gomti Amn(8), 
= ἘΦ oe 
Bun = Bunn a, b; g) ΞΞ ρῶππι — gomti Bunn(8)s 
with 
2m +1 (m — n)! 
Amnlg) = 2π (m + n)! 
2π - 
Χ | | g(v, 6) cos n6 sin” ἢ oP™ (cos ¢) de db, 
0 0 
2m 1 (m — n)! 
Bnn(g) = ΕΑ i ( ) 


2π (m + η)} 
2x κ 
Χ | | g(y, 6) sin nO sin”t* eP™ (cos v) dy dé 
0 0 


(0) u(r, φ, θ) = Σ; [βακούνγμο ΞΕ eS lomn(r umn + Banal 
where ie με 


Omn(t) = Amn(b, a; fir" — BF) + Anna, ὃ; 8) 
x [r” - Gee τ 
Bmn(t) = Βικιίῥ, α; flr" — δον ἘΠῚ + Β,ρκ(α, δ; 8) 
x [r” _ “τ ΤΩΝ, 
with notation as in part (a) 
Section 14-7 


3. Qo — 202 

5. r3u39 = —Bx2z — By2z + 23 r3u31 = —8x?y — By? + 6yz? 
r3u31 = —3x > — ὅχγϑ + 6xz? r?v39 = 30xyz 
r3u32 = 15(x?z — y?z) r3v33 = 15(x2y — γ5) 


r3u33 = 15(x? — 3xy”) 
n! 
nin — 2p 


το πὰ 5 συ 
(,--2)--1,27-1 = (—1) (27+ 1) — 2) — 1)! 


1 Ὁ αν ἘΞ (1) 


Ca=i4 
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9, (a) x© — 15x4y2 + 1σχ γῇ — y6 
(b) x°y — 42x3y3 + χγὅ 
(c) x® + 6x5y — 15x4y? — 20x3y3 + 15x2y4 + bxyd — yo 
11. x* — 6x2z? + 24 x8y — 3xyz? 
x2y2 — 272 _ y2z2 4 1γ4 xy — 3xyz? 
4 — 6y2z?2 4 24 x3z — xz3 
x*yz — 4yz3 xy*z — 4x23 
y3z — yz3 
13. (a) r°uzo0 = —3(x? — Ζῇ — ἔξ — σχῇ (b) x? — 2? = —r?ua0 + Jr?uee 
r2u21 = 3(xz) xy = ér%v22 
γέμου = 3(x? — 27) — 3(y? — 2?) y? — 22 = —r*u29 — dr7uee 
r2vo1 = 302) xz = true 
r2v09 = 6(xy) yz = 4r*vo1 
17. dinatan = ("= ἢ ἐ{π τι ἢ 
κ-- 2 k— 2 
Chapter 15 
Section 15-1 
3. Set x = Ar 
Section 15-2 
1. x = +1 regular singular points; x = 0 irregular singular point 
3. x = +1 regular singular points 
5. x = 1 regular singular point; x = 0 irregular singular point 
7. x = Oand x = 1 regular singular points 
9. x = 0 regular singular point 
Section 15-3 
3. (a) »? —~1=0 (Ὁ) vp? --3ν —1=0 
(Ὁ p? —3y +1 = (d) v2? — 2v — 2? = O 
(e) v2 = 0 
5. v* = 0, in each case. 
᾿ = 1)" x 
gi en cop altys ie 7 1/3 (= 
Yi jx] (+ $x), yo = |x| Qo BGK ~— 5)Bk — 2)* 
00 1 i 
9. 1.12 ΘΛ 
yi |x| » Y2 |x| Σ᾿ TERR — 1 
= rACA — 1)°° ‘A-kKtD 
11.» - aol + >) (-1) aye 


k=1 


If X = 0, y = ao; if X is a positive integer, then 


y= a 1" 


x. 


oS DEE 
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Section 15-4 


1/2 2j — 15 
= |x| / >, apx’, where ao 


1. yi ΖΞ = 1, ak = rT wera ἀξ 4k —-i- 1 Qj, 
k21;0 < |x| < 4; 
. 1 <j -- 8 
k 
— = = OO = ° 
ye Σ᾽ a where ao = 1, a = FR ΠΣ τ pay te ΚῈ 1; |x] « 4 
3, γι = | o> * where ao = 1, ax = ee ce) aa St (A144 + 7)α; 
k=1;0 < |x| «4: 
a) ( 1) k— 
_ k - τ᾿ TE A 747 
y2 = Σ᾿ ae where ao = 1, ae = seria Ξ ΣΟ 1)44 + Day, 
k = 1; |x| < 4 
co 2 os 
= . = et eM τς eee ΓΞ » 1: : 
5. y1 = Da ar, where ao 1, a 3k(k {τ Ὁ De is ΚΞ Tex 1 
2/3 00 ᾿ 2 k—1 
J2 = |x| Dy ax ᾿ where ao = is a, = - ora (4) Ξ-- 5)a;, 
= j=0 
k>1;0 < |x| <1 
=. (- τ 
7. = ἘΞΞ = 
yl «Dy aex , where ao = 1, a k(4k + K(k + 3). 2 (—1)'(4j + 3)ay, | 
k = 1; |x| <1; 
4 k (-1)'4 SG p 
y2 = |x Σ᾿ ae where agp = 1, a; = Gk - kak — δ ἢ 1) jaj, ΚΞ 1; 
0 < |x| «1 


11. 


13. 


me gat cae os ee τε 
νι τα ἘΣ ποτε ares" ἐὺς 


“σ΄ = I k| τι 
y2 = |x| t+ Lacorsa a" 0 < |x| « 


v1 = i, ag = lgivea, = —2 — i, a2 = τὸ Ὄ 5» az = ττῖξς — τσοὶ; 
vo = —i, ag = 1 βίνε αι = —2 4+ Hi, az = το — doi, a3 = --ἴξο + τβσί: 
This yields y = ciyi1 + c2y2, where 
yi = 6 — 2x + hr? -- Aer? t+: *-) cos (In |x|) 
+ (hx — Ayx? + gdor? + τ) sin Cn [x)), 

(—bx + yx? -- τ σχϑ + τ) cos (In xp 

$= Bet ye? — Ax? + 0) sin in xp, 
This solution is valid for 0 < mi < 0. 


y2 


V1 = /2i, ag = 1 give a, = 0, ag = ---------» a3 ΞΞ Ὁ; 


yo = —V/2i, ag = 1 give a, = 0, ag = ----------" a3 = 0. 
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This yields y = c1y1 + ce2y2, where 
γι = (1 — 4x +008 ΜΖ |x) + (— vee 4 +») sin @/2In xb, 
(ae χ τ: Ὶ cos (\/2 In |x|) + ( -- iy? + -+-)sin @/2 In |x]). 


This solution is valid for 0 < |x| < 1. 

15. νι = i, ag = 1 give αι = 4(-—2 — i), ag = ao 3 — i), a3 = 5365 (67 + 813), 
ve = —I1, ao = 1 givea, = z(—2 +i), a2 = 3603 + i), a3 = 5360 (67 — 81). 
This yields y = c1y1 + coy2 where 
γι = 1 — 2x + Sx? + οὔτοχῆ + - - 7) cos (in [x]) 

+ (§x + εχ — τὸς 
yo = (-χ — sox? + zp? + "") cos (in |x|) 
+ (1 — Bx + εἶχ" + oSdox? +--+) sin in |x). 
This solution is valid for Ὁ < |x| < ο. 


te ¢) 


17. (a) v = Ogives y = DD a(x — 1)’, 
k=0 


y2 


5x? +°: ‘) sin (In |x|), 


where 
(-1)"" 1)**? k— πε 
ΠΕΙΤΕΣ Σ (—1)'27AQ + 1) — Πα; k 2 1. 
j=0 


(Note. It can be shown that, with a9 = 1, the formulas above imply that 


A DA+1)—(k -- DADA+ 1) — ἰ -- 2) -- 11: Ἐ1) -0:1 
alae τ στ | eae a 


any = 


χα - 1)" 
so that if \ is a non-negative integer ἡ, then y is a polynomial of degree 7.) 
(b) --1 < x < 3. (If) isa non-negative integer, then the solution is valid for all x.) 
Section 15-5 


1. γι = X, γὲ = ye ae + xInx 


k==1 
seep + va 
yo = 2x" EC 1) σε ἢ xe 4 x! [ + Σ (—1)" a “| In x 
5. yi = 4 aaa aay +4 yo = 1 + Bx + bx 
7. γι =x + Σ (Ὴἰ GEE ἘΣ ἜΣ Σ τ τε 


9. yr = 1 — 3x + ἔχ" -- 2χ", 


4)! 


yo = Tx — 28x? 4 dbx? — ἜΣ) ae t+ (1 — 3x + $x” — 4x”) Inx 
k=4 : 
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11. If 2p is not an integer, Case I; if p = 0, Case II; if 2p is an integer other than zero, 
Case III. 


Section 15-6 
3. Ifp = 0,J,%) —~ lasx — 0; if p > 0, ρα) — 0 as x — 0; if p < 0 and p is 
not an integer, then J,(x) -Ὁ +0 as x— 0. 


9. (b) y = — Ζι40 722) + 2x Zi «α΄ 2), 
2xZ314(x2/2) 
[Note. Every y of this form is a solution of y’ = x? + y? on every interval 
on which x ~ 0 and Zj,4(x?/2) is defined and nonvanishing. Any given 
solution y may be so represented by choosing the pair of arbitrary constants 
in Z1/4(x?/2) = x—1/2u(x) in infinitely many different ways, corresponding to 
the solutions u of the differential equation γ(χ) = —u’'(x)/u(x).] 


Section 15-7 
12 192 72 384)\ ., 
3. J5(x) = (2 - 2) Jo(x) — (: ae: + ᾿ς Jo(x) 
19. (Ὁ) y = £71 [0 + s?)— 9/7] 


Section [5-9 
3. If h = p in Case III, the functions J,(»;,x), k = 1,2,3,...,do not form a basis 
for PC[0, 1]. 


Section 15--10 


J 
st EY = 7s), 0O<xe< 1, 


5. Ifp >0,x7=2)>> 
rai [μὲ — P MJp(ur)l 
where μὰ is the kth positive zero of J, (x). If p = O then x? = 1 and the Dini series 


contains a single nonvanishing term, 2co = 1. 
Section 15-1] 


1. u = >) [4g sinh λκία — z) + By sinh dxzVo(d.r), 


k=1 
where A; is the kth positive zero of Jo(x), and 


1 
2 
A, = ΠΙΌΔΙ sinh Asa (,))2 sinh Aga [ F(r)Jo(aAxr)r dr, 


2 


1 
~ [iQ)2 sinh Aa [ g(r)Jo(Anr)r dr 


B, 


3.u = δ) Agsinh Ala — z) JoOur), 
k=1 
where ), 1s the kth positive zero of Jo(A) = 0 and 
200 


Ai ie εις, τ τς --.:- 
ξ΄ μη Ox) sinh Aza 
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5.u= cylnr+ co; u = c10 + co; u = ci1z + ce. In the third situation u is a 
possible temperature distribution in the cylinder; in the first two situations this is 
true only in the special cases in which c; = 0. 


Section 15-12 
xo) “oo + 1) — JO) Yo + | 
Jo) YOU) — Jol) YoC1) 


| ae ca — 


3. u(r, θ, 2) = >) Σ΄ [Ang cos πθ + Ang Sin nO\Jn(Aner) sinh Ania — 2), 
n=0 k=1 


where 2d, is the kth positive zero of J,(A), and 


τ 1 
1 
\. = ------------- - --- . θ 00 dr dé, 
Abt = 77 Oe. Ne sinh hoi Lf Ds PHO Now ar 
π 1 
᾿ | 
ὡς ΟΣ [1 ee, θ dr d0, π > 0. 

Ant τη, One) Sin Nyaa iin gee Canc reo pe 
— 2 


π 1 
| / f(r, MJnnzr)r sin nO dr do 
—r JQ 


Ank = Tai QanF sinh Nena 


5. u(r, θ, 1) = >) >) Aan bdan(A2n,aF) COS (Nan,x at) sin 278, 
n=1 k=1 


where \2n,x is the Ath positive zero of J2,(A) and 


Pe ae 
ONE W[Jan+1.\Q2n,n)]? 
with u(r, 0,0) = f(r, 9) 


a/2 J 
| [ f(r, DJan(Q2n,xr)r sin 2ηθ dr dé, 
J0 


0 


i.e) 


7. u(r, 6, t) ἘΞ Σ > [Ank COS (Ans /a,Kat) + Bni sin (λ,, τ, α,κα1}} 


n=1 k=] 
x J πια(ληπιία,ΚΓ) sin (n/a) 
where λρπία, is the Ath positive zero of ,πια(λ) and 


α 1 
: ᾿ i | | 
A,nk = = r, θ)υ ,π|α(ληπια, ΥῊΓ sin (n/a) dr dd, 
: OS a+na) /a(Anr/a,k)]? 0 0 ft ) : ( ὠὰ ) 
a | 
- | i : 
B.~ = ——— SS  -- r, OD)Jaxla(Anr/a,kr)r sin (nr0/a) dr dé, 
: ἀαληπία, εἰν (α-μηπὴ,α(ληπια,.}}2 0 0 a ) ; ( pr 


with u(r, 0,0) = f(r, 9) and u,(r, 0,0) = g(r, 6) 


Α 


Abel’s formula, 117 
Addition 
of functions in @[a, b], 3 
of geometric vectors, 34 
of linear transformations, 45 
of matrices, 70 
in a vector space, 6 
of vectors in ®”, 7 
Airy’s differential equation, 241 
Amplitude equation, 537 
Angle between vectors, 263 
Arc 
differentiable, 364 
simple, 364 
Arithmetic means, 396 


B 


Basis 
in a Euclidean space, 317 
In 92 (-- οὐ, ©), 438 
in 95[0, ©), 444 
orthogonal, 271, 317 
orthonormal, 278 
in ΦΟΙ --π, 7], 338, 360 
in PC[—1, 1], 409, 410, 424 
in ΦΟΙΟ, 1], 621 
standard in Sinn, 71 
standard in &”, 22 
in a vector space, 21 
Bernoulli’s equation, 98 
Bessel functions 
Bessel’s integral form for, 614 
differentiation formulas for, 606 
generating function for, 613 
of half-integral order, 606 


index 


Laplace transform of, 205, 611, 612 
modified, 616, 617, 630 
of order n of the second kind, 604 
of order p of the first kind, 599 
of order —p of the first kind, 601 
of order zero of the first kind, 600 
of order zero of the second kind, 603 
Poisson integral form for, 616 
recurrence relations for, 616 
zeros of, 235, 608, 609 
Bessel’s equation 
of order p, 234, 597 
of order zero, 157, 250 
zeros of solutions of, 235 
Bessel series 
of the first kind, 622 
of the second kind, 624 
Bessel’s inequality, 272, 319 
Bilinear, 257 
Biorthogonal 
series, 535 
sets of functions, 535 
Bolzano-Weierstrass theorem, 389 
Boundary conditions 
for heat equation, 513, 514 
homogeneous, 458 
periodic, 478 
for second-order equations, 457 
unmixed, 478 
for wave equation, 514 
Boundary-value problem 
for ordinary differential equations, 457 


for partial differential equations, 506, 507 


ς 


Cancellation law, 12 
Cauchy 
inequality, 263 
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product, 254 of order n, 380 

sequence, 639 Vandermonde, 116, 137 
Cauchy-Schwarz inequality, 262 Diagonal form, 465 
Center of mass, 296 Differentiation as a linear transformation, 
Cesaro summable, 396 44 
Characteristic Diffusion equation, 513 

equation, 467 Dimension of a vector space, 23 

exponent, 591 Dini series, 624 

polynomial, 467, 699 Directed line segment, 32 

values, 461 Dirichlet’s formula, 374 

vector, 461 Distance 
Christoffel’s identity, 426 to a line, 284 
Circuit, electrical, 170 to a plane, 285 
Closed subspace, 323 to a subspace, 282 
Closure between vectors, 264 

of a subset, 325 Divergence 

of a subspace, 324 theorem, 713, 719 
Cofactor, 688 of a vector field, 712, 719 
Comparison test, 644 Domain of a linear transformation, 42 
Components of a vector, 26 Dot product, 257 

in R2, 1 
Convergence E 

absolute, 648 

conditional, 650 Eigenfunction, 460, 474 

in a Euclidean space, 304 Eigenvalue, 460, 461 

of integrals, 179, 671, 672, 673, 674 method, 466, 484 

mean, 307, 314 Eigenvector, 460, 461 

in R", 306 Endpoint conditions, 457 

pointwise, 306, 338, 656 Equivalence 

of a sequence of real numbers, 305, 638 class, 38 

of a series, 242, 311, 314, 642, 661 relation, 37 

uniform, 658, 661, 672, 674 Euclidean space, 256 
Continuity, 652, 653 Euler 

uniform, 652, 653 equation, 161, 586 
Convolution formula, 206 formula, 129 
Coordinate axes, 26 Euler-Fourier coefficients, 338 
Coordinates of a vector, 26 Even extension, 350 
Coordinate system, 26 Exchange principle, 18 
Cramer’s rule, 695 Existence 
Critical damping, 227 problem, 83 
Curl of a vector field, 718 theorems, 104, 243 

F 
D : 
Fejer’s theorem, 399, 403 

Definite integral, 655 Flux, 711 

as a linear transformation, 44 Fourier coefficients, 287, 314, 317, 338 
Delaying factor, 195 Fourier-Legendre coefficients, 421 
Delay time, 171 Fourier series 
Derivative, right- and left-hand, 374 cosine, 351 
Determinant differentiation of, 391, 392 

expansion of, 388 double, 367, 534 


Gramm, 283 expansion, 338 


generalized, 317, 322 
integration of, 392, 393 
mean convergence of, 314, 338, 363 


pointwise convergence of, 340, 342, 369, 


374, 379 

sine, 351 

uniform convergence of, 380, 382 
Free-end condition, 513 
Frequency, 519 
Frobenius, method of, 583, 594 
Function 

analytic, 243 

Bessel (see Bessel) 

beta, 211 

broken line, 400 

continuous, 652, 653 

differentiable, 654 

Dirac delta, 223 

even, 334 

even extension of, 350 

even part of, 336 

of exponential order, 180 


gamma (generalized factorial), 211, 599 


harmonic, 562 
Hermite, 443 
null, 332 
odd, 334 
odd extension of, 351 
odd part of, 336 
order of, 677 
periodic, 198, 347 
periodic extension of, 342 
piecewise continuous, 177, 330, 364 
piecewise smooth, 340 
uniformly continuous, 652, 653 
unit step, 194 
Fundamental theorem of Calculus, 655 


G 


Gamma function, 211, 599 
Gauss’s theorem, 719 
Generating function 
for Bessel functions, 613 
for. Hermite polynomials, 451 
for Laguerre polynomials, 451 
for Legendre polynomials, 448 
Geometric vector, 33 
Gibbs 
interval, 387, 390 
phenomenon, 386, 387 
Gradient, 718 
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Gramm determinant, 283 
Gamm-Schmidt orthogonalization 
process, 277 
Green’s 
first identity, 719 
functions, 141, 147, 149, 212, 494, 498 
second identity, 719 


H 


Half-life, 168 
Half-wave symmetry, 359 
Harmonic 
function, 562, 567 
motion, damped, 227 
motion, simple, 168, 226 
polynomial, 574, 576 
Heat equation, 509 
one-dimensional, 528 
two-dimensional, 513, 532 
steady-state solutions of, 546 
Hermite 
equation, 250, 441 
functions, 443 
Hermite polynomials, 438, 537 
differential equation for, 441 
norms of, 439 
orthogonality of, 439 
recurrence relation for, 440 
Homogeneous 
linear differential equation, 91 
operator equation, 81 
polynomial, 574 
polynomial; harmonic, 575 
system of linear equations, 84 


I 


Image of a linear transformation, 42 
Impedence, steady-state, 171, 174 
Impulse, 222 
Indefinite integral, as a linear 
transformation, 44 
Indicial equation, 163, 587, 591 
Infinite series 
convergent, 311, 642 
divergent, 311, 642 
in a Euclidean space, 311 
partial sums of, 311, 342 
of real numbers, 642 
Initial conditions, 104 
Initial-value problem, 103 
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Inner product inverse, 185 
standard, in @[a, δ], 257, 258 of a periodic function, 198 
standard, in ®”, 257, 258 table of, 228-230 
weighted, 258 Laplacian, 718 
Inner product space, 256 Least squares, method of, 292 
Integral test, 645 Least upper bound principle, 637 
Integration as a linear transformation, 44 Legendre equation, 246, 248, 413 
Intermediate value property, 654 power series solution of, 248 
Interval Legendre polynomials, 278, 280, 410, 
closed, 3 483, 559 
open, 3 differential equation for, 413 
Invariant norms of, 417 
of a second-order linear differential orthogonality of, 414, 418, 562 
equation, 236 recurrence relation for, 417 
subspace, 68, 462 Rodrigues’ formula for, 410 
Inverse roots of, 417 
left, 59 Legendre series 
of a linear transformation, 57 mean convergence of, 421 
right, 59 pointwise convergence of, 423, 429, 
Inversion, 683 432 
Inverting the operator, method of, 83 uniform convergence of, 429 
Isomorphism, 57 Leibnitz 
formula, 150, 671 
J rule, 90 
Length of a vector, 261 
Jacobian determinant, 705 Lerch’s theorem, 185, 678 
Jump discontinuity, 330 Limits, right- and left-hand, 330 
Linear combination of vectors, 14 
K Linear dependence, 19 
Linear differential equation 
Kirchhoff’s laws, 170 associated homogeneous equation of, 92 
Kronecker delta, 269 first-order, ordinary, 95 
homogeneous, 91 
L nonhomogeneous, 91 
normal, 91 
Lagrange identity, 477 ordinary, of order 7, 91 
Laguerre equation, 446, 447, 590 partial, 505 
Laguerre polynomials, 444, 447 self-adjoint form of, 237, 476 
differential equation for, 446, 447 with constant coefficients, 129, 134 
norms of, 444 Linear differential operator, 52, 86, 505 
orthogonality of, 444 coefficients of, 86 
recurrence relation for, 444 constant coefficient, 51, 88, 89, 126 
Laplace equation equidimensional (Euler), 90 
in circular regions, 553 factoring, 52, 88, 89, 126 
in cylindrical coordinates, 582 order of, 86 
in polar coordinates, 547 | self-adjoint form of, 237, 476 
in rectangular coordinates, 509, 546 Linear independence, 19 
in rectangular regions, 548 Linear operator (see Linear 
in spherical coordinates, 548 transformation) . 
in spherical regions, 558, 564 Linear transformation 
Laplace series, 571 addition of, 45 
Laplace transform definition of, 41 


definition of, 179 domain of, 42 


idempotent, 61 
identity, 43 

image of, 42 
invertible, 57 

matrix of, 64 
minimum polynomial of, 72 
nilpotent, 51 

null space of, 55 
polynomials in, 51 
powers of, 50 
products of, 48 
one-to-one, 56 

onto, 42 

range of, 42 

scalar multiples of, 47 
symmetric, 471 

zero, 43 

Lipschitz condition, 378 


Lower bound, 182, 637 


greatest, 182, 637 


M 
Matrix 


addition, 70 

characteristic polynomial of, 699 
definition of, 64 

diagonal, 80, 465 

identity, 66 

of a linear transformation, 64 
minimum polynomial! of, 77 
multiplication, 75 | 
nilpotent, 79 

nonsingular, 689, 699 

principal diagonal of, 77 
similarity, 699 

symmetric, 472 

transpose, 685 

triangular, 471 

zero, 66 

Maximum-minimum property, 654 


Mean convergence, 307, 314 


Mean square deviation, 287 


Mean value theorem 


for derivatives, 655 
for integrals, 656 


Minor, 688 
Mobius strip, 707 
Momentum, 168 
Multiplication 


of linear transformations, 48 
of matrices, 75 
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N 


Nilpotent, linear transformation, 51 
matrix, 79 

Node, 519 

Normal equations, 294 

Normal vector to a surface, 701, 708 


O 


Odd extension, 351 
Operator equation, 81 
Orthogonal, 268 
Orthogonalization, 277 
Orthonormal, 268 


P 


Parallelogram law, 1 
Parseval’s equality, 272, 319, 322, 363 
Particular solution, 81, 92 
Partition of a set, 39 
Pendulum, simple, 167 
Permutation, 682 
even, 683 
odd, 683 
Periodic 
extension, 342 
function, 198, 347 
Perpendicular 
projection, 282 
vectors, 268 
Phase angle, 171, 174 
Piecewise continuous function, 177, 330, 
364 
Pointwise convergence, 306, 338, 656 
Poisson integral form, 556, 616 
Polynomial 
characteristic, 467, 699 
Hermite, 438, 537 
Laguerre, 444, 447 
Legendre, 278, 280, 410, 483, 559 
minimum, 72, 77 
space of, 8, 13 
Population growth, 166 
Positive definite, 257 
Power series, 242, 661 
differentiation of, 242, 662 
integration of, 663 
Product 
of linear transformations, 48 
of matrices, 75 
of power series, 254 
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Projection, 61, 282 
Pythagorean theorem, 268 


R 


Radius of convergence, 242, 662 
Range of a linear transformation, 42 
Ratio test, 645, 649 
Real vector space, 1, 6, (see also Vector 
space) 
Recurrence relation, 345, 417, 440, 444, 
616 
Reduction in order, method of, 154 
Reflexive, 37 
Region 
bounded, 654 
closed, 654 
connected, 507 
pathwise connected, 507 
Resonance, 174, 221 
Resonating frequency, 174 
Riccati equation, 100, 605 
Riemann-Lebesgue lemma, 371 
Rodrigues’ formula, 410 


5 


Scalar field, 705 
Scalar multiplication 

in Θ[α, bj, 4 

for linear transformations, 47 

for matrices, 70 

in R2, 2 

in R”, 7 
Schr6dinger wave equation, 536 
Self-adjoint form, 237, 476 
Separation of variables, method of, 516 
Sequence 

Cauchy, 639 

convergent, 304, 306, 638 

of functions, 655 

monotonic nondecreasing, 639 

monotonic nonincreasing, 538, 639 


pointwise convergence of, 306, 338, 656 


of real numbers, 638 
uniform convergence of, 658 
uniformly bounded, 538 
of vectors, 304 
Series 
alternating, 650 
Bessel, 622, 624 
Dini, 624 


Fourier, 317, 338, (see also Fourier 
series) 
geometric, 642 
harmonic, 644 
Laplace, 571 
Legendre, 421, (see also Legendre 
series) 
p, 646 
power, 242, 661, (see also Power 
series) 
Shifting theorem 
first, 193 
second, 195 
Singular point, 583 
irregular, 584 
regular, 584 
Sonin Polya theorem, 238 
Spanned, 14 
Spherical harmonics, 567 
Steady-state current, 171 
Sturm comparison theorem, 232, 238 
Sturm-Liouville problem, 479 
Sturm separation theorem, 231 
Subspace, 12 
closed, 323 
criterion, 12 
generated by a set, 325 
intersection, 14, 17 
invariant, 68, 462 
spanned by a set, 14 
Subtraction of vectors, 8 
Summable 
by arithmetic means, 396 
Cesaro, 396 
uniformly Cesaro, 399 
Surface 
area, 704 
explicit representation of, 700 
implicit representation of, 700 
integral, 705, 708 
nonorientable, 708 
orientable, 708 
parametric equations for, 700 
piecewise smooth, 713 
smooth, 701 
zonal harmonics, 562 
Surface integral 
of a scalar field, 705 
of a vector field, 708 
Symmetric, 37, 257 
Symmetric matrix, 261 
System of linear equations, 83, 84, 694 


Τ 


Taylor series, 667 
Taylor’s formula, 666 
Test for linear independence, 20 
Transient 

charge, 173 

current, 171 
Transitive, 37 
Transpose of a matrix, 685 
Triangle inequality, 264 
Trigonometric polynomial, 269 


U 


Undetermined coefficients, method of, 


158, 244 
Uniform continuity, 652, 653 
Uniqueness problem, 83 
Uniqueness theorem, 104, 718 
Upper bound, least, 637 


Vv 


Variance, 296 
Variation of parameters, 141 
Vector 

addition, 1, 3, 6 
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INDEX 


field, 707 
product, 704 
Vector space 
of functions, 3, 13, 183, 332 
of linear transformations, 47 
of matrices, 70 
of polynomials, 8, 13, 575 
Vibrating spring, 218 


Ww 


Wave equation, 509 
d’Alembert’s solution of, 515 
one-dimensional, 509, 516 
Schr6édinger, 510 
two-dimensional, 510 

Weierstrass 


approximation theorem, 360, 406, 


408, 578 
M-test, 660 
Weight function, 258 
Wronskian, 111 


Z 


Zero vector, 6 
Zonal harmonics, 562 
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